2024-09-17T16:29:26.214 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T16:29:26.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T16:29:26.322 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084 branch: wip-bharath10-testing-2024-09-17-1348 description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zlib} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} email: skanta@redhat.com first_in_suite: false job_id: '7909084' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-bharath10-testing-2024-09-17-1348 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 2500 ms tcp read timeout: 5 osd_recovery_max_active: 10 osd_recovery_max_single_start: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true bluestore write v2: false bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - slow request - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath10-testing-2024-09-17-1348 sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 3421 sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath10-testing-2024-09-17-1348 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCMrkOwHr4RJUGACr1IaaLBp39mGlS2OcsH3TpbQO0/Fihokeag1JyHgN9gnF7CQixYQK3J9fmLHjK1gqhSAcbI= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCCj6mZULdeO8A3yDfcxtIzHFZKlJv6deCOn/MxewJoJBJIbiSYvKUHewbmz9w1x2puH6PKBbPEx5rlrc0vaNYo= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwlriYrQpQPSt7huiN82c8YQCAWUPj5khhOrH0N3EvlBdQjx35LWk5GAL5YOZxSrR9V/xV6M+hiI5aCRtA8308= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO28man8ZYL6/OISsKR05uz+dKIS5jNIvUwbEXyULPGP/G4KJqUpPScWn18Cr7zON+6CVGjQH0SYzk5JBvZHIpA= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: aggressive_pg_num_changes: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 8 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: c: 2 crush-failure-domain: osd k: 4 m: 3 name: shecprofile plugin: shec objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_15:01:33 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T16:29:26.323 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa; will attempt to use it 2024-09-17T16:29:26.323 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa/tasks 2024-09-17T16:29:26.324 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T16:29:26.325 INFO:teuthology.task.internal:Checking packages... 2024-09-17T16:29:26.346 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1889a165b5128787ec693450a3d1c5df5d6dc203' 2024-09-17T16:29:26.347 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T16:29:26.347 INFO:teuthology.packaging:ref: None 2024-09-17T16:29:26.347 INFO:teuthology.packaging:tag: None 2024-09-17T16:29:26.347 INFO:teuthology.packaging:branch: wip-bharath10-testing-2024-09-17-1348 2024-09-17T16:29:26.347 INFO:teuthology.packaging:sha1: 1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:29:26.347 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-bharath10-testing-2024-09-17-1348 2024-09-17T16:29:26.498 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4975.g1889a165 2024-09-17T16:29:26.500 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T16:29:26.505 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T16:29:26.505 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T16:29:26.586 INFO:teuthology.task.internal:Saving configuration 2024-09-17T16:29:26.603 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T16:29:26.640 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T16:29:26.664 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 16:23:55.172700', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCMrkOwHr4RJUGACr1IaaLBp39mGlS2OcsH3TpbQO0/Fihokeag1JyHgN9gnF7CQixYQK3J9fmLHjK1gqhSAcbI='} 2024-09-17T16:29:26.683 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 16:23:55.174191', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCCj6mZULdeO8A3yDfcxtIzHFZKlJv6deCOn/MxewJoJBJIbiSYvKUHewbmz9w1x2puH6PKBbPEx5rlrc0vaNYo='} 2024-09-17T16:29:26.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 16:23:55.175748', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwlriYrQpQPSt7huiN82c8YQCAWUPj5khhOrH0N3EvlBdQjx35LWk5GAL5YOZxSrR9V/xV6M+hiI5aCRtA8308='} 2024-09-17T16:29:26.727 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 16:23:55.170770', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO28man8ZYL6/OISsKR05uz+dKIS5jNIvUwbEXyULPGP/G4KJqUpPScWn18Cr7zON+6CVGjQH0SYzk5JBvZHIpA='} 2024-09-17T16:29:26.727 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T16:29:26.732 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-09-17T16:29:26.732 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-09-17T16:29:26.732 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-09-17T16:29:26.732 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-09-17T16:29:26.733 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T16:29:26.840 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f018b9cfbe0>, signals=[15]) 2024-09-17T16:29:26.840 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T16:29:26.845 INFO:teuthology.task.internal:Opening connections... 2024-09-17T16:29:26.845 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:29:26.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:29:26.926 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:29:26.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:29:27.002 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:29:27.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:29:27.075 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:29:27.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:29:27.150 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T16:29:27.156 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-17T16:29:27.174 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-17T16:29:27.174 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-17T16:29:27.233 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-17T16:29:27.233 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T16:29:27.234 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T16:29:27.235 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-17T16:29:27.263 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-17T16:29:27.282 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-17T16:29:27.282 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-17T16:29:27.340 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-17T16:29:27.340 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-17T16:29:27.340 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-17T16:29:27.340 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T16:29:27.341 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T16:29:27.342 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-17T16:29:27.363 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-09-17T16:29:27.381 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-09-17T16:29:27.382 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T16:29:27.440 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-09-17T16:29:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-09-17T16:29:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T16:29:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-09-17T16:29:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T16:29:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T16:29:27.441 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T16:29:27.441 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-09-17T16:29:27.463 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-09-17T16:29:27.482 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-09-17T16:29:27.483 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-09-17T16:29:27.540 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T16:29:27.541 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T16:29:27.541 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-09-17T16:29:27.563 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T16:29:27.571 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T16:29:27.677 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T16:29:27.677 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-17T16:29:27.680 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-17T16:29:27.682 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-09-17T16:29:27.685 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-09-17T16:29:27.702 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T16:29:27.708 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T16:29:27.708 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-17T16:29:27.738 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-17T16:29:27.740 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-09-17T16:29:27.742 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-09-17T16:29:27.847 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T16:29:27.950 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T16:29:28.021 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T16:29:28.021 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T16:29:28.021 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T16:29:28.022 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T16:29:28.022 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T16:29:28.023 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T16:29:28.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:29:28.040 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-17T16:29:28.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:29:28.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:29:28.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:29:28.042 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-09-17T16:29:28.043 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-17T16:29:28.043 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-17T16:29:28.097 INFO:teuthology.orchestra.run.smithi111.stdout:5.14.0-503.el9.x86_64 2024-09-17T16:29:28.098 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.14.0-503.el9.x86_64 2024-09-17T16:29:28.098 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum install -y kernel 2024-09-17T16:29:28.100 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-503.el9.x86_64 2024-09-17T16:29:28.100 INFO:teuthology.task.kernel:Running kernel on smithi098: 5.14.0-503.el9.x86_64 2024-09-17T16:29:28.100 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum install -y kernel 2024-09-17T16:29:28.102 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-17T16:29:28.102 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-503.el9.x86_64 2024-09-17T16:29:28.102 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-17T16:29:28.102 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-17T16:29:28.102 INFO:teuthology.task.kernel:Running kernel on smithi183: 5.14.0-503.el9.x86_64 2024-09-17T16:29:28.103 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2024-09-17T16:29:30.460 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-17T16:29:30.820 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.3 MB 00:00 2024-09-17T16:29:30.889 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.3 MB 00:00 2024-09-17T16:29:31.939 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-17T16:29:32.630 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-17T16:29:36.268 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-09-17T16:29:37.022 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-17T16:29:38.531 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 19 kB 00:00 2024-09-17T16:29:39.502 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-17T16:29:39.643 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-17T16:29:42.530 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-17T16:29:43.703 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-17T16:29:43.981 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-17T16:29:44.894 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-17T16:29:45.187 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-17T16:29:45.224 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T16:29:45.983 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-17T16:29:47.064 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T16:29:47.064 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T16:29:47.156 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:29:47.167 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:29:47.167 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-17T16:29:47.167 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:29:47.167 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:29:47.167 INFO:teuthology.orchestra.run.smithi111.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout:Install 4 Packages 2024-09-17T16:29:47.168 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:29:47.169 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 79 M 2024-09-17T16:29:47.169 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 126 M 2024-09-17T16:29:47.169 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:29:47.475 INFO:teuthology.orchestra.run.smithi111.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 126 kB/s | 36 kB 00:00 2024-09-17T16:29:50.291 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T16:29:51.481 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T16:29:52.206 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T16:29:52.206 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T16:29:52.263 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:20 2024-09-17T16:29:52.290 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:29:52.303 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:29:52.303 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:29:52.304 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:29:52.305 INFO:teuthology.orchestra.run.smithi183.stdout:Install 4 Packages 2024-09-17T16:29:52.305 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:29:52.305 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 79 M 2024-09-17T16:29:52.305 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 126 M 2024-09-17T16:29:52.305 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:29:52.542 INFO:teuthology.orchestra.run.smithi183.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 287 kB/s | 36 kB 00:00 2024-09-17T16:29:53.429 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T16:29:53.430 INFO:teuthology.orchestra.run.smithi098.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T16:29:53.493 INFO:teuthology.orchestra.run.smithi183.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-17T16:29:53.509 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:29:53.519 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:29:53.519 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-17T16:29:53.520 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:29:53.521 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 79 M 2024-09-17T16:29:53.521 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 126 M 2024-09-17T16:29:53.521 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:29:53.624 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 437 kB/s | 36 kB 00:00 2024-09-17T16:29:54.101 INFO:teuthology.orchestra.run.smithi183.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 18 MB/s | 29 MB 00:01 2024-09-17T16:29:54.468 INFO:teuthology.orchestra.run.smithi183.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-17T16:29:54.468 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:29:54.468 INFO:teuthology.orchestra.run.smithi183.stdout:Total 36 MB/s | 79 MB 00:02 2024-09-17T16:29:55.145 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:29:55.328 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-17T16:29:55.477 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:29:55.478 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:29:56.462 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:29:56.463 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:29:57.680 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-17T16:29:58.024 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-09-17T16:29:58.886 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:29:59.506 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-17T16:29:59.554 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:29:59.636 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:00.468 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-17T16:30:01.216 INFO:teuthology.orchestra.run.smithi111.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.1 MB/s | 16 MB 00:14 2024-09-17T16:30:02.398 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:02.520 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:03.024 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.6 MB/s | 35 MB 00:09 2024-09-17T16:30:03.024 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:30:03.024 INFO:teuthology.orchestra.run.smithi098.stdout:Total 8.3 MB/s | 79 MB 00:09 2024-09-17T16:30:03.702 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:30:04.068 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:30:04.069 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:30:05.026 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:30:05.026 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:30:06.033 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-17T16:30:07.501 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:30:07.504 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:07.628 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:08.006 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T16:30:08.007 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T16:30:08.101 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:30:08.116 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:30:08.116 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-17T16:30:08.117 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:30:08.118 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-17T16:30:08.118 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-17T16:30:08.118 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:30:08.235 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 397 kB/s | 36 kB 00:00 2024-09-17T16:30:08.318 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:30:08.409 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:08.627 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-17T16:30:09.018 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-17T16:30:09.327 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-17T16:30:09.327 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:30:09.327 INFO:teuthology.orchestra.run.smithi060.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-17T16:30:10.039 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:30:10.384 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:30:10.385 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:30:11.156 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:11.305 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:11.392 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:30:11.392 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:30:12.456 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:30:14.633 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:30:14.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:16.126 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:16.239 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:17.616 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:21.089 INFO:teuthology.orchestra.run.smithi111.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 871 kB/s | 29 MB 00:33 2024-09-17T16:30:21.111 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:22.736 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:22.775 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:27.915 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:29.821 INFO:teuthology.orchestra.run.smithi111.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 830 kB/s | 35 MB 00:42 2024-09-17T16:30:29.822 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:30:29.822 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.8 MB/s | 79 MB 00:42 2024-09-17T16:30:30.504 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:30:30.874 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:30:30.874 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:30:31.810 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:30:31.810 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:30:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:30:35.024 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:30:35.122 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:37.999 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:42.845 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:42.883 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:47.705 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:50.709 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:50.750 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:30:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:51.122 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:30:51.965 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:51.965 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:30:51.965 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:30:51.965 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T16:30:51.965 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T16:30:51.965 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T16:30:51.966 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T16:30:51.966 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:30:51.966 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:30:52.329 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:30:52.411 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:30:52.411 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:30:52.411 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T16:30:52.412 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T16:30:52.412 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T16:30:52.412 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-17T16:30:52.412 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T16:30:52.412 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:30:52.471 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:30:52.471 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:30:52.471 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2024-09-17T16:30:52.506 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.06 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 82.el9 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Group : Unspecified 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 8274670 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T16:30:52.507 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : builder@centos.org 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:30:52.508 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T16:30:52.509 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T16:30:52.509 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 5.14.0-508.el9.x86_64 2024-09-17T16:30:52.510 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T16:30:53.197 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2024-09-17T16:30:54.591 INFO:teuthology.orchestra.run.smithi183.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T16:30:54.636 INFO:teuthology.orchestra.run.smithi183.stderr:done 2024-09-17T16:30:54.638 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-09-17T16:30:54.654 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.RNqGMSUMxv 2024-09-17T16:30:54.654 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.RNqGMSUMxv 2024-09-17T16:30:54.721 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.RNqGMSUMxv 2024-09-17T16:30:54.864 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.RNqGMSUMxv is 6KB 2024-09-17T16:30:54.913 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.RNqGMSUMxv 2024-09-17T16:30:54.928 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T16:30:54.990 INFO:teuthology.orchestra.run.smithi183.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T16:30:54.990 INFO:teuthology.orchestra.run.smithi183.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T16:30:54.990 INFO:teuthology.orchestra.run.smithi183.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T16:30:54.990 INFO:teuthology.orchestra.run.smithi183.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T16:30:54.992 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T16:30:55.143 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2024-09-17T16:30:59.263 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:59.303 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:59.583 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:30:59.584 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:30:59.584 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:30:59.584 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:31:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:31:00.459 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:31:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T16:31:00.459 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T16:31:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T16:31:00.460 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:31:00.460 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:31:00.830 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:31:00.912 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:00.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:31:00.913 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T16:31:00.913 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T16:31:00.913 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T16:31:00.913 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T16:31:00.913 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi098.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T16:31:00.913 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:31:00.972 INFO:teuthology.orchestra.run.smithi098.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:00.972 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:31:00.972 DEBUG:teuthology.orchestra.run.smithi098:> sudo rpm -qi grub2-tools 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Name : grub2-tools 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Epoch : 1 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Version : 2.06 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Release : 82.el9 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Architecture: x86_64 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Group : Unspecified 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Size : 8274670 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:License : GPLv3+ 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T16:31:01.005 INFO:teuthology.orchestra.run.smithi098.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:Packager : builder@centos.org 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:Vendor : CentOS 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:Summary : Support tools for GRUB. 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:Description : 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout:hardware devices. 2024-09-17T16:31:01.006 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:31:01.007 INFO:teuthology.orchestra.run.smithi098.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T16:31:01.007 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T16:31:01.007 INFO:teuthology.task.kernel:Updating grub on smithi098 to boot 5.14.0-508.el9.x86_64 2024-09-17T16:31:01.008 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T16:31:01.570 INFO:teuthology.orchestra.run.smithi098.stderr:Generating grub configuration file ... 2024-09-17T16:31:02.810 INFO:teuthology.orchestra.run.smithi098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T16:31:02.838 INFO:teuthology.orchestra.run.smithi098.stderr:done 2024-09-17T16:31:02.840 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-17T16:31:02.880 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.3qb7txqeBB 2024-09-17T16:31:02.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3qb7txqeBB 2024-09-17T16:31:02.947 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.3qb7txqeBB 2024-09-17T16:31:03.092 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.3qb7txqeBB is 6KB 2024-09-17T16:31:03.142 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.3qb7txqeBB 2024-09-17T16:31:03.156 DEBUG:teuthology.orchestra.run.smithi098:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T16:31:03.220 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T16:31:03.220 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T16:31:03.220 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T16:31:03.220 INFO:teuthology.orchestra.run.smithi098.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T16:31:03.221 DEBUG:teuthology.orchestra.run.smithi098:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T16:31:03.376 DEBUG:teuthology.orchestra.run.smithi098:> sudo shutdown -r now 2024-09-17T16:31:06.548 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:06.589 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:06.968 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:06.968 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:31:06.968 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:31:06.968 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:31:07.820 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:07.820 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:31:07.820 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:31:07.820 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:07.820 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T16:31:07.820 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T16:31:07.821 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T16:31:07.821 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:31:07.821 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:31:08.173 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:31:08.260 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:08.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:31:08.261 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T16:31:08.261 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T16:31:08.261 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T16:31:08.261 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T16:31:08.261 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T16:31:08.261 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:31:08.319 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:08.320 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:31:08.320 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-17T16:31:08.361 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-17T16:31:08.361 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-17T16:31:08.361 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T16:31:08.362 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:31:08.363 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T16:31:08.364 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T16:31:08.364 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T16:31:08.364 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-17T16:31:08.364 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:31:08.364 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T16:31:08.365 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T16:31:08.365 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-508.el9.x86_64 2024-09-17T16:31:08.366 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T16:31:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-17T16:31:10.315 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T16:31:10.343 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-17T16:31:10.345 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-17T16:31:10.406 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.AmYxSFA1Gr 2024-09-17T16:31:10.406 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AmYxSFA1Gr 2024-09-17T16:31:10.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.AmYxSFA1Gr 2024-09-17T16:31:10.567 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.AmYxSFA1Gr is 6KB 2024-09-17T16:31:10.615 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.AmYxSFA1Gr 2024-09-17T16:31:10.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T16:31:10.696 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T16:31:10.696 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T16:31:10.696 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T16:31:10.696 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T16:31:10.697 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T16:31:10.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-17T16:31:25.146 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-17T16:31:25.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:31:25.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:31:25.865 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:25.908 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:26.316 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:26.316 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T16:31:26.316 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T16:31:26.316 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:31:27.223 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:31:27.575 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:31:27.655 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:27.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:31:27.655 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T16:31:27.656 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T16:31:27.656 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T16:31:27.656 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-17T16:31:27.656 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T16:31:27.656 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T16:31:27.717 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T16:31:27.717 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T16:31:27.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -qi grub2-tools 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Name : grub2-tools 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Epoch : 1 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Version : 2.06 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Release : 82.el9 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: x86_64 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Group : Unspecified 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:Size : 8274670 2024-09-17T16:31:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:License : GPLv3+ 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Packager : builder@centos.org 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Vendor : CentOS 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Summary : Support tools for GRUB. 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:Description : 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T16:31:27.750 INFO:teuthology.orchestra.run.smithi111.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T16:31:27.751 INFO:teuthology.orchestra.run.smithi111.stdout:hardware devices. 2024-09-17T16:31:27.751 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:31:27.751 INFO:teuthology.orchestra.run.smithi111.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T16:31:27.751 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T16:31:27.752 INFO:teuthology.task.kernel:Updating grub on smithi111 to boot 5.14.0-508.el9.x86_64 2024-09-17T16:31:27.752 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T16:31:28.500 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-09-17T16:31:29.796 INFO:teuthology.orchestra.run.smithi111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T16:31:29.843 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-09-17T16:31:29.846 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-17T16:31:29.862 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.9xn72DbKt2 2024-09-17T16:31:29.862 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9xn72DbKt2 2024-09-17T16:31:29.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.9xn72DbKt2 2024-09-17T16:31:30.075 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.9xn72DbKt2 is 6KB 2024-09-17T16:31:30.122 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.9xn72DbKt2 2024-09-17T16:31:30.137 DEBUG:teuthology.orchestra.run.smithi111:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T16:31:30.209 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T16:31:30.209 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T16:31:30.209 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T16:31:30.209 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T16:31:30.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T16:31:30.370 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-09-17T16:31:33.381 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T16:31:33.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T16:31:33.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:31:40.853 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T16:31:40.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-17T16:31:40.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:31:43.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-09-17T16:31:51.869 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T16:31:52.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:31:52.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:31:55.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-09-17T16:31:59.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-09-17T16:32:00.373 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-17T16:32:00.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:32:00.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:00.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T16:32:00.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:03.933 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-09-17T16:32:07.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:32:07.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:08.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-17T16:32:08.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:15.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T16:32:15.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:18.749 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-17T16:32:26.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-09-17T16:32:27.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:32:27.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:30.813 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-17T16:32:41.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:32:41.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:41.546 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-09-17T16:32:41.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:32:41.841 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-17T16:32:41.841 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2024-09-17T16:32:41.855 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-508.el9.x86_64 2024-09-17T16:32:41.855 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T16:32:41.855 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T16:32:41.855 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T16:32:42.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:32:42.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:32:42.856 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-17T16:32:42.856 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T16:32:42.986 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2024-09-17T16:32:43.009 DEBUG:teuthology.parallel:result is None 2024-09-17T16:32:45.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-17T16:32:47.961 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-17T16:32:48.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T16:32:48.327 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T16:32:48.327 DEBUG:teuthology.orchestra.run.smithi098:> uname -r 2024-09-17T16:32:48.341 INFO:teuthology.orchestra.run.smithi098.stdout:5.14.0-508.el9.x86_64 2024-09-17T16:32:48.342 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T16:32:48.342 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T16:32:48.342 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T16:32:49.342 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T16:32:49.342 DEBUG:teuthology.orchestra.run.smithi098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T16:32:49.454 INFO:teuthology.orchestra.run.smithi098.stdout:ttyS1 2024-09-17T16:32:49.482 DEBUG:teuthology.parallel:result is None 2024-09-17T16:33:00.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:33:00.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:33:08.297 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T16:33:19.421 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-17T16:33:20.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-17T16:33:20.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:33:20.703 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-17T16:33:21.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-17T16:33:21.041 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T16:33:21.041 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-17T16:33:21.092 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-508.el9.x86_64 2024-09-17T16:33:21.092 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T16:33:21.092 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T16:33:21.092 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T16:33:22.094 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T16:33:22.094 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T16:33:22.174 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-09-17T16:33:22.192 DEBUG:teuthology.parallel:result is None 2024-09-17T16:33:37.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:33:37.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:33:37.739 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-17T16:33:38.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:33:38.107 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-17T16:33:38.107 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-17T16:33:38.122 INFO:teuthology.orchestra.run.smithi111.stdout:5.14.0-508.el9.x86_64 2024-09-17T16:33:38.122 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T16:33:38.122 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T16:33:38.122 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T16:33:39.123 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-17T16:33:39.124 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T16:33:39.199 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-09-17T16:33:39.227 DEBUG:teuthology.parallel:result is None 2024-09-17T16:33:39.227 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T16:33:39.234 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T16:33:39.235 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T16:33:39.237 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T16:33:39.239 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T16:33:39.242 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T16:33:39.262 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T16:33:39.311 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T16:33:39.468 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T16:33:39.469 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T16:33:39.472 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T16:33:39.474 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T16:33:39.478 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T16:33:39.519 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T16:33:39.550 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T16:33:39.550 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T16:33:39.553 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T16:33:39.556 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T16:33:39.558 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T16:33:39.590 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.591 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.591 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.602 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.603 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.603 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.605 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.616 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T16:33:39.618 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T16:33:39.626 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T16:33:39.626 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T16:33:39.647 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T16:33:39.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T16:33:39.652 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T16:33:39.680 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T16:33:39.689 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T16:33:39.689 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T16:33:39.718 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T16:33:39.720 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T16:33:39.722 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T16:33:39.739 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:39.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:39.873 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:39.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:40.002 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:33:40.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T16:33:40.070 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:40.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:40.165 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:40.248 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:40.291 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:33:40.291 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T16:33:40.357 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:40.404 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:40.467 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:40.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:40.553 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:33:40.553 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T16:33:40.619 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:40.664 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T16:33:40.920 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:40.964 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T16:33:41.011 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:33:41.011 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T16:33:41.080 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-17T16:33:41.082 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-17T16:33:41.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-09-17T16:33:41.087 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-09-17T16:33:41.132 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:33:41.138 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:33:41.139 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:33:41.172 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:33:41.613 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T16:33:41.620 INFO:teuthology.task.internal:Starting timer... 2024-09-17T16:33:41.620 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T16:33:41.685 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T16:33:41.932 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-17T16:33:41.993 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-17T16:33:41.994 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-17T16:33:42.064 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-17T16:33:42.065 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2024-09-17T16:33:42.134 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2024-09-17T16:33:42.136 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-09-17T16:33:42.209 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-09-17T16:33:42.211 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T16:33:42.211 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-17T16:33:42.240 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-17T16:33:42.240 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-17T16:33:42.267 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-17T16:33:42.268 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2024-09-17T16:33:42.314 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2024-09-17T16:33:42.314 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-09-17T16:33:42.341 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-09-17T16:33:42.341 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi111.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-09-17T16:33:42.341 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:33:42.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:33:42.370 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:33:42.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:33:42.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:33:42.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:33:42.427 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:33:42.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:33:42.455 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T16:33:42.455 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-17T16:33:42.487 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-17T16:33:42.519 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2024-09-17T16:33:42.552 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-09-17T16:33:42.580 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T16:33:42.819 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T16:33:42.831 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T16:33:42.832 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi098.front.sepia.ceph.com,smithi111.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T16:37:36.654 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-09-17T16:37:36.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-17T16:37:36.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:37:36.741 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-17T16:37:36.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-17T16:37:36.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T16:37:36.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:37:36.912 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-17T16:37:36.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-17T16:37:36.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:37:36.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:37:37.068 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-17T16:37:37.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-17T16:37:37.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:37:37.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T16:37:37.225 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-09-17T16:37:37.314 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-17T16:37:37.315 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T16:37:37.326 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T16:37:37.326 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T16:37:37.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:37:37.329 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T16:37:37.329 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:37:37.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T16:37:37.332 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:37:37.335 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T16:37:37.335 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T16:37:37.363 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T16:37:37.364 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T16:37:37.378 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T16:37:37.379 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T16:37:37.379 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T16:37:37.386 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T16:37:37.401 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T16:37:37.405 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-17T16:37:37.405 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2024-09-17T16:37:37.407 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-17T16:37:37.418 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-17T16:37:37.418 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2024-09-17T16:37:37.419 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-17T16:37:37.427 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-09-17T16:37:37.431 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T16:37:37.431 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T16:37:37.435 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T16:37:37.439 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-09-17T16:37:37.445 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T16:37:37.446 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T16:37:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T16:37:37.454 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T16:37:37.468 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T16:37:37.498 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:37:37.502 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:37:37.503 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:37:37.503 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-09-17T16:37:37.503 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.503 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.503 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.503 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:37:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-17T16:37:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.506 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.513 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:37:37.517 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:37:37.518 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-17T16:37:37.518 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.518 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.518 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.518 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.529 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:37:37.532 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:37:37.533 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-09-17T16:37:37.533 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.533 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.533 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.533 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:37:37.534 INFO:teuthology.run_tasks:Running task install... 2024-09-17T16:37:37.542 DEBUG:teuthology.task.install:project ceph 2024-09-17T16:37:37.542 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T16:37:37.542 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'} 2024-09-17T16:37:37.542 INFO:teuthology.task.install:Using flavor: default 2024-09-17T16:37:37.549 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T16:37:37.549 INFO:teuthology.task.install:extra packages: [] 2024-09-17T16:37:37.549 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'tag': None, 'wait_for_package': False} 2024-09-17T16:37:37.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:37:37.551 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'tag': None, 'wait_for_package': False} 2024-09-17T16:37:37.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:37:37.552 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'tag': None, 'wait_for_package': False} 2024-09-17T16:37:37.553 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:37:37.554 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'tag': None, 'wait_for_package': False} 2024-09-17T16:37:37.554 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:37:37.704 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/ 2024-09-17T16:37:37.704 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4975.g1889a165 2024-09-17T16:37:37.711 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/ 2024-09-17T16:37:37.711 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4975.g1889a165 2024-09-17T16:37:37.718 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/ 2024-09-17T16:37:37.718 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4975.g1889a165 2024-09-17T16:37:37.721 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/ 2024-09-17T16:37:37.722 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4975.g1889a165 2024-09-17T16:37:37.819 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T16:37:37.819 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:37:37.819 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T16:37:37.823 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T16:37:37.824 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:37:37.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T16:37:37.831 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T16:37:37.832 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:37:37.832 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T16:37:37.836 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-bharath10-testing-2024-09-17-1348/1889a165b5128787ec693450a3d1c5df5d6dc203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T16:37:37.837 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:37:37.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T16:37:37.845 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T16:37:37.845 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1889a165b5128787ec693450a3d1c5df5d6dc203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T16:37:37.853 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T16:37:37.853 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1889a165b5128787ec693450a3d1c5df5d6dc203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T16:37:37.858 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T16:37:37.858 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1889a165b5128787ec693450a3d1c5df5d6dc203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T16:37:37.862 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T16:37:37.863 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1889a165b5128787ec693450a3d1c5df5d6dc203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T16:37:37.910 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T16:37:37.922 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T16:37:37.924 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T16:37:37.929 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T16:37:37.985 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T16:37:37.999 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T16:37:38.000 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T16:37:38.003 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T16:37:38.049 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-09-17T16:37:38.051 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-09-17T16:37:38.063 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2024-09-17T16:37:38.065 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2024-09-17T16:37:38.066 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-17T16:37:38.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-17T16:37:38.069 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-17T16:37:38.070 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-17T16:37:38.276 INFO:teuthology.orchestra.run.smithi183.stdout:45 files removed 2024-09-17T16:37:38.297 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-17T16:37:38.302 INFO:teuthology.orchestra.run.smithi111.stdout:45 files removed 2024-09-17T16:37:38.303 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw 2024-09-17T16:37:38.305 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-17T16:37:38.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw 2024-09-17T16:37:38.329 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw 2024-09-17T16:37:38.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw 2024-09-17T16:37:38.904 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 284 kB/s | 84 kB 00:00 2024-09-17T16:37:38.905 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 269 kB/s | 84 kB 00:00 2024-09-17T16:37:38.908 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 286 kB/s | 84 kB 00:00 2024-09-17T16:37:38.943 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 270 kB/s | 84 kB 00:00 2024-09-17T16:37:39.243 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 83 kB/s | 24 kB 00:00 2024-09-17T16:37:39.244 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 81 kB/s | 24 kB 00:00 2024-09-17T16:37:39.244 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 81 kB/s | 24 kB 00:00 2024-09-17T16:37:39.260 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2024-09-17T16:37:39.518 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-17T16:37:39.519 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-17T16:37:39.520 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-17T16:37:39.536 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-17T16:37:39.951 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 21 MB/s | 8.3 MB 00:00 2024-09-17T16:37:41.269 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-17T16:37:42.112 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-17T16:37:42.195 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-17T16:37:42.486 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.3 MB 00:02 2024-09-17T16:37:49.220 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.5 MB 00:03 2024-09-17T16:37:50.996 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-17T16:37:51.808 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-17T16:37:57.190 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-09-17T16:37:59.399 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 11 M 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.5 M 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.3 M 2024-09-17T16:37:59.416 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 22 M 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:19.3.0-4975.g1889a165.el9 ceph 25 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 756 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T16:37:59.417 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 508 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 45 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 143 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:19.3.0-4975.g1889a165.el9 ceph 161 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:19.3.0-4975.g1889a165.el9 ceph 321 k 2024-09-17T16:37:59.418 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 305 k 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 99 k 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout:Installing weak dependencies: 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout:Install 31 Packages 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 2 Packages 2024-09-17T16:37:59.419 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:37:59.420 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 62 M 2024-09-17T16:37:59.420 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:38:00.174 INFO:teuthology.orchestra.run.smithi111.stdout:(1/33): ceph-base-19.3.0-4975.g1889a165.el9.x86 10 MB/s | 5.5 MB 00:00 2024-09-17T16:38:00.204 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:16 2024-09-17T16:38:00.224 INFO:teuthology.orchestra.run.smithi111.stdout:(2/33): ceph-selinux-19.3.0-4975.g1889a165.el9. 506 kB/s | 25 kB 00:00 2024-09-17T16:38:00.308 INFO:teuthology.orchestra.run.smithi111.stdout:(3/33): libcephfs2-19.3.0-4975.g1889a165.el9.x8 8.9 MB/s | 756 kB 00:00 2024-09-17T16:38:00.392 INFO:teuthology.orchestra.run.smithi111.stdout:(4/33): libradosstriper1-19.3.0-4975.g1889a165. 6.0 MB/s | 508 kB 00:00 2024-09-17T16:38:00.684 INFO:teuthology.orchestra.run.smithi111.stdout:(5/33): ceph-radosgw-19.3.0-4975.g1889a165.el9. 10 MB/s | 11 MB 00:01 2024-09-17T16:38:00.759 INFO:teuthology.orchestra.run.smithi111.stdout:(6/33): librgw2-19.3.0-4975.g1889a165.el9.x86_6 15 MB/s | 5.5 MB 00:00 2024-09-17T16:38:00.784 INFO:teuthology.orchestra.run.smithi111.stdout:(7/33): python3-ceph-argparse-19.3.0-4975.g1889 451 kB/s | 45 kB 00:00 2024-09-17T16:38:00.818 INFO:teuthology.orchestra.run.smithi111.stdout:(8/33): python3-ceph-common-19.3.0-4975.g1889a1 2.4 MB/s | 143 kB 00:00 2024-09-17T16:38:00.843 INFO:teuthology.orchestra.run.smithi111.stdout:(9/33): python3-cephfs-19.3.0-4975.g1889a165.el 2.7 MB/s | 161 kB 00:00 2024-09-17T16:38:00.876 INFO:teuthology.orchestra.run.smithi111.stdout:(10/33): python3-rados-19.3.0-4975.g1889a165.el 5.3 MB/s | 321 kB 00:00 2024-09-17T16:38:00.902 INFO:teuthology.orchestra.run.smithi111.stdout:(11/33): python3-rbd-19.3.0-4975.g1889a165.el9. 5.1 MB/s | 305 kB 00:00 2024-09-17T16:38:00.927 INFO:teuthology.orchestra.run.smithi111.stdout:(12/33): python3-rgw-19.3.0-4975.g1889a165.el9. 1.9 MB/s | 99 kB 00:00 2024-09-17T16:38:01.069 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-17T16:38:01.128 INFO:teuthology.orchestra.run.smithi111.stdout:(13/33): ceph-common-19.3.0-4975.g1889a165.el9. 15 MB/s | 22 MB 00:01 2024-09-17T16:38:01.186 INFO:teuthology.orchestra.run.smithi111.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-09-17T16:38:01.228 INFO:teuthology.orchestra.run.smithi111.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-17T16:38:01.253 INFO:teuthology.orchestra.run.smithi111.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 523 kB/s | 171 kB 00:00 2024-09-17T16:38:01.279 INFO:teuthology.orchestra.run.smithi111.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-17T16:38:01.312 INFO:teuthology.orchestra.run.smithi111.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-17T16:38:01.337 INFO:teuthology.orchestra.run.smithi111.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 723 kB/s | 42 kB 00:00 2024-09-17T16:38:01.363 INFO:teuthology.orchestra.run.smithi111.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-17T16:38:01.388 INFO:teuthology.orchestra.run.smithi111.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-17T16:38:01.413 INFO:teuthology.orchestra.run.smithi111.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-17T16:38:01.447 INFO:teuthology.orchestra.run.smithi111.stdout:(23/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-17T16:38:01.506 INFO:teuthology.orchestra.run.smithi111.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-17T16:38:01.531 INFO:teuthology.orchestra.run.smithi111.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-17T16:38:01.556 INFO:teuthology.orchestra.run.smithi111.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 275 kB/s | 26 kB 00:00 2024-09-17T16:38:01.582 INFO:teuthology.orchestra.run.smithi111.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T16:38:01.623 INFO:teuthology.orchestra.run.smithi111.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-17T16:38:01.693 INFO:teuthology.orchestra.run.smithi111.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 839 kB 00:00 2024-09-17T16:38:01.743 INFO:teuthology.orchestra.run.smithi111.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-17T16:38:01.810 INFO:teuthology.orchestra.run.smithi111.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-17T16:38:01.927 INFO:teuthology.orchestra.run.smithi111.stdout:(32/33): librados2-19.3.0-4975.g1889a165.el9.x8 15 MB/s | 3.5 MB 00:00 2024-09-17T16:38:01.994 INFO:teuthology.orchestra.run.smithi111.stdout:(33/33): librbd1-19.3.0-4975.g1889a165.el9.x86_ 13 MB/s | 3.3 MB 00:00 2024-09-17T16:38:01.998 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:01.999 INFO:teuthology.orchestra.run.smithi111.stdout:Total 24 MB/s | 62 MB 00:02 2024-09-17T16:38:02.108 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:38:02.144 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:38:02.144 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:38:02.819 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:38:02.819 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:38:03.693 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:20 2024-09-17T16:38:04.344 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:38:04.420 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-17T16:38:04.449 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-17T16:38:04.482 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-17T16:38:04.505 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:04.532 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:04.707 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:04.761 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:05.239 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-17T16:38:05.505 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.5 MB 00:01 2024-09-17T16:38:05.507 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:05.602 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:05.704 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 8/35 2024-09-17T16:38:05.735 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:05.798 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:05.835 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-17T16:38:05.879 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 11/35 2024-09-17T16:38:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:05.979 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:06.052 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:06.086 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-17T16:38:06.194 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-17T16:38:06.223 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-17T16:38:06.279 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-17T16:38:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-17T16:38:06.339 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-17T16:38:06.373 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:06.410 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-17T16:38:06.620 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-17T16:38:06.747 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-17T16:38:06.795 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:06.886 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:06.916 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 24/35 2024-09-17T16:38:06.952 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-17T16:38:07.339 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-17T16:38:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-17T16:38:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:07.630 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 28/35 2024-09-17T16:38:07.691 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 29/35 2024-09-17T16:38:07.944 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-17T16:38:08.168 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-17T16:38:08.220 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-17T16:38:09.158 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-17T16:38:09.519 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-17T16:38:10.074 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:10.104 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:10.299 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-17T16:38:10.679 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:10.716 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:10.813 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:10.814 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T16:38:10.814 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T16:38:10.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:10.862 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:13.624 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T16:38:14.697 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-17T16:38:15.671 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-17T16:38:15.859 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:38:15.870 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:15.870 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:38:15.870 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:15.870 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:38:15.870 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 11 M 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.5 M 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.3 M 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 22 M 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-4975.g1889a165.el9 ceph 25 k 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T16:38:15.871 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 756 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 508 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 45 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 143 k 2024-09-17T16:38:15.872 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-4975.g1889a165.el9 ceph 161 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-4975.g1889a165.el9 ceph 321 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 305 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 99 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:38:15.873 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:15.874 INFO:teuthology.orchestra.run.smithi098.stdout:Install 31 Packages 2024-09-17T16:38:15.874 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 2 Packages 2024-09-17T16:38:15.874 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:15.874 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 62 M 2024-09-17T16:38:15.874 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:38:16.617 INFO:teuthology.orchestra.run.smithi098.stdout:(1/33): ceph-base-19.3.0-4975.g1889a165.el9.x86 9.6 MB/s | 5.5 MB 00:00 2024-09-17T16:38:16.676 INFO:teuthology.orchestra.run.smithi098.stdout:(2/33): ceph-selinux-19.3.0-4975.g1889a165.el9. 432 kB/s | 25 kB 00:00 2024-09-17T16:38:16.843 INFO:teuthology.orchestra.run.smithi098.stdout:(3/33): ceph-radosgw-19.3.0-4975.g1889a165.el9. 14 MB/s | 11 MB 00:00 2024-09-17T16:38:16.884 INFO:teuthology.orchestra.run.smithi098.stdout:(4/33): libcephfs2-19.3.0-4975.g1889a165.el9.x8 3.5 MB/s | 756 kB 00:00 2024-09-17T16:38:16.910 INFO:teuthology.orchestra.run.smithi098.stdout:(5/33): libradosstriper1-19.3.0-4975.g1889a165. 7.5 MB/s | 508 kB 00:00 2024-09-17T16:38:16.960 INFO:teuthology.orchestra.run.smithi098.stdout:(6/33): python3-ceph-argparse-19.3.0-4975.g1889 904 kB/s | 45 kB 00:00 2024-09-17T16:38:16.986 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:38:17.002 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 11 M 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.5 M 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.3 M 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:38:17.003 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 22 M 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.3.0-4975.g1889a165.el9 ceph 25 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 756 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 508 k 2024-09-17T16:38:17.004 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 45 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 143 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.3.0-4975.g1889a165.el9 ceph 161 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.3.0-4975.g1889a165.el9 ceph 321 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 305 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 99 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T16:38:17.005 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout:Install 31 Packages 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 2 Packages 2024-09-17T16:38:17.006 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:17.007 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 62 M 2024-09-17T16:38:17.007 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:38:17.052 INFO:teuthology.orchestra.run.smithi098.stdout:(7/33): python3-ceph-common-19.3.0-4975.g1889a1 1.5 MB/s | 143 kB 00:00 2024-09-17T16:38:17.277 INFO:teuthology.orchestra.run.smithi098.stdout:(8/33): ceph-common-19.3.0-4975.g1889a165.el9.x 18 MB/s | 22 MB 00:01 2024-09-17T16:38:17.303 INFO:teuthology.orchestra.run.smithi098.stdout:(9/33): python3-cephfs-19.3.0-4975.g1889a165.el 645 kB/s | 161 kB 00:00 2024-09-17T16:38:17.378 INFO:teuthology.orchestra.run.smithi098.stdout:(10/33): librgw2-19.3.0-4975.g1889a165.el9.x86_ 11 MB/s | 5.5 MB 00:00 2024-09-17T16:38:17.403 INFO:teuthology.orchestra.run.smithi098.stdout:(11/33): python3-rados-19.3.0-4975.g1889a165.el 2.5 MB/s | 321 kB 00:00 2024-09-17T16:38:17.428 INFO:teuthology.orchestra.run.smithi098.stdout:(12/33): python3-rbd-19.3.0-4975.g1889a165.el9. 2.4 MB/s | 305 kB 00:00 2024-09-17T16:38:17.454 INFO:teuthology.orchestra.run.smithi098.stdout:(13/33): python3-rgw-19.3.0-4975.g1889a165.el9. 1.3 MB/s | 99 kB 00:00 2024-09-17T16:38:17.521 INFO:teuthology.orchestra.run.smithi098.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 914 kB/s | 107 kB 00:00 2024-09-17T16:38:17.587 INFO:teuthology.orchestra.run.smithi098.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 682 kB/s | 45 kB 00:00 2024-09-17T16:38:17.638 INFO:teuthology.orchestra.run.smithi098.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 872 kB/s | 160 kB 00:00 2024-09-17T16:38:17.663 INFO:teuthology.orchestra.run.smithi098.stdout:(17/33): libnbd-1.20.2-2.el9.x86_64.rpm 817 kB/s | 171 kB 00:00 2024-09-17T16:38:17.713 INFO:teuthology.orchestra.run.smithi098.stdout:(18/33): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-17T16:38:17.738 INFO:teuthology.orchestra.run.smithi098.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 562 kB/s | 42 kB 00:00 2024-09-17T16:38:17.773 INFO:teuthology.orchestra.run.smithi098.stdout:(20/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-17T16:38:17.823 INFO:teuthology.orchestra.run.smithi098.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 428 kB/s | 36 kB 00:00 2024-09-17T16:38:17.824 INFO:teuthology.orchestra.run.smithi060.stdout:(1/33): ceph-base-19.3.0-4975.g1889a165.el9.x86 11 MB/s | 5.5 MB 00:00 2024-09-17T16:38:17.848 INFO:teuthology.orchestra.run.smithi098.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-09-17T16:38:17.872 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:38:17.873 INFO:teuthology.orchestra.run.smithi098.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-09-17T16:38:17.882 INFO:teuthology.orchestra.run.smithi060.stdout:(2/33): ceph-selinux-19.3.0-4975.g1889a165.el9. 434 kB/s | 25 kB 00:00 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 11 M 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.5 M 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.3 M 2024-09-17T16:38:17.888 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 22 M 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.3.0-4975.g1889a165.el9 ceph 25 k 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 756 k 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T16:38:17.889 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 508 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.3.0-4975.g1889a165.el9 ceph 5.5 M 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 45 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.3.0-4975.g1889a165.el9 ceph 143 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.3.0-4975.g1889a165.el9 ceph 161 k 2024-09-17T16:38:17.890 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.3.0-4975.g1889a165.el9 ceph 321 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 305 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.3.0-4975.g1889a165.el9 ceph 99 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:17.891 INFO:teuthology.orchestra.run.smithi183.stdout:Install 31 Packages 2024-09-17T16:38:17.892 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2024-09-17T16:38:17.892 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:17.892 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 62 M 2024-09-17T16:38:17.892 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:38:17.932 INFO:teuthology.orchestra.run.smithi098.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-17T16:38:17.957 INFO:teuthology.orchestra.run.smithi098.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 312 kB/s | 26 kB 00:00 2024-09-17T16:38:17.983 INFO:teuthology.orchestra.run.smithi060.stdout:(3/33): libcephfs2-19.3.0-4975.g1889a165.el9.x8 7.4 MB/s | 756 kB 00:00 2024-09-17T16:38:17.983 INFO:teuthology.orchestra.run.smithi098.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 972 kB/s | 49 kB 00:00 2024-09-17T16:38:17.999 INFO:teuthology.orchestra.run.smithi098.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-17T16:38:18.033 INFO:teuthology.orchestra.run.smithi098.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-17T16:38:18.066 INFO:teuthology.orchestra.run.smithi098.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-17T16:38:18.108 INFO:teuthology.orchestra.run.smithi060.stdout:(4/33): ceph-radosgw-19.3.0-4975.g1889a165.el9. 14 MB/s | 11 MB 00:00 2024-09-17T16:38:18.133 INFO:teuthology.orchestra.run.smithi098.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T16:38:18.141 INFO:teuthology.orchestra.run.smithi060.stdout:(5/33): libradosstriper1-19.3.0-4975.g1889a165. 3.1 MB/s | 508 kB 00:00 2024-09-17T16:38:18.209 INFO:teuthology.orchestra.run.smithi098.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-17T16:38:18.225 INFO:teuthology.orchestra.run.smithi060.stdout:(6/33): python3-ceph-argparse-19.3.0-4975.g1889 542 kB/s | 45 kB 00:00 2024-09-17T16:38:18.400 INFO:teuthology.orchestra.run.smithi060.stdout:(7/33): librgw2-19.3.0-4975.g1889a165.el9.x86_6 19 MB/s | 5.5 MB 00:00 2024-09-17T16:38:18.434 INFO:teuthology.orchestra.run.smithi098.stdout:(32/33): librados2-19.3.0-4975.g1889a165.el9.x8 9.4 MB/s | 3.5 MB 00:00 2024-09-17T16:38:18.451 INFO:teuthology.orchestra.run.smithi060.stdout:(8/33): python3-cephfs-19.3.0-4975.g1889a165.el 3.1 MB/s | 161 kB 00:00 2024-09-17T16:38:18.542 INFO:teuthology.orchestra.run.smithi098.stdout:(33/33): librbd1-19.3.0-4975.g1889a165.el9.x86_ 8.0 MB/s | 3.3 MB 00:00 2024-09-17T16:38:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:18.548 INFO:teuthology.orchestra.run.smithi098.stdout:Total 23 MB/s | 62 MB 00:02 2024-09-17T16:38:18.659 INFO:teuthology.orchestra.run.smithi060.stdout:(9/33): ceph-common-19.3.0-4975.g1889a165.el9.x 16 MB/s | 22 MB 00:01 2024-09-17T16:38:18.664 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:38:18.684 INFO:teuthology.orchestra.run.smithi060.stdout:(10/33): python3-rados-19.3.0-4975.g1889a165.el 1.3 MB/s | 321 kB 00:00 2024-09-17T16:38:18.701 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:38:18.862 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:38:18.863 INFO:teuthology.orchestra.run.smithi060.stdout:(11/33): python3-rbd-19.3.0-4975.g1889a165.el9. 4.5 MB/s | 305 kB 00:00 2024-09-17T16:38:18.863 INFO:teuthology.orchestra.run.smithi060.stdout:(12/33): python3-ceph-common-19.3.0-4975.g1889a 272 kB/s | 143 kB 00:00 2024-09-17T16:38:18.864 INFO:teuthology.orchestra.run.smithi060.stdout:(13/33): python3-rgw-19.3.0-4975.g1889a165.el9. 1.1 MB/s | 99 kB 00:00 2024-09-17T16:38:18.894 INFO:teuthology.orchestra.run.smithi060.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 640 kB/s | 107 kB 00:00 2024-09-17T16:38:18.919 INFO:teuthology.orchestra.run.smithi060.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2024-09-17T16:38:18.936 INFO:teuthology.orchestra.run.smithi060.stdout:(16/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-17T16:38:18.953 INFO:teuthology.orchestra.run.smithi060.stdout:(17/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 770 kB/s | 45 kB 00:00 2024-09-17T16:38:18.995 INFO:teuthology.orchestra.run.smithi060.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-17T16:38:19.037 INFO:teuthology.orchestra.run.smithi060.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-17T16:38:19.070 INFO:teuthology.orchestra.run.smithi060.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-17T16:38:19.087 INFO:teuthology.orchestra.run.smithi060.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 713 kB/s | 36 kB 00:00 2024-09-17T16:38:19.113 INFO:teuthology.orchestra.run.smithi060.stdout:(22/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-17T16:38:19.129 INFO:teuthology.orchestra.run.smithi060.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-09-17T16:38:19.188 INFO:teuthology.orchestra.run.smithi060.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.0 MB/s | 308 kB 00:00 2024-09-17T16:38:19.213 INFO:teuthology.orchestra.run.smithi060.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 384 kB/s | 26 kB 00:00 2024-09-17T16:38:19.239 INFO:teuthology.orchestra.run.smithi060.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 968 kB/s | 49 kB 00:00 2024-09-17T16:38:19.264 INFO:teuthology.orchestra.run.smithi060.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T16:38:19.297 INFO:teuthology.orchestra.run.smithi060.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T16:38:19.331 INFO:teuthology.orchestra.run.smithi060.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-17T16:38:19.390 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:38:19.390 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:38:19.415 INFO:teuthology.orchestra.run.smithi060.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-17T16:38:19.507 INFO:teuthology.orchestra.run.smithi060.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-17T16:38:19.573 INFO:teuthology.orchestra.run.smithi060.stdout:(32/33): librados2-19.3.0-4975.g1889a165.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-17T16:38:19.614 INFO:teuthology.orchestra.run.smithi183.stdout:(1/33): ceph-base-19.3.0-4975.g1889a165.el9.x86 3.3 MB/s | 5.5 MB 00:01 2024-09-17T16:38:19.655 INFO:teuthology.orchestra.run.smithi183.stdout:(2/33): ceph-selinux-19.3.0-4975.g1889a165.el9. 611 kB/s | 25 kB 00:00 2024-09-17T16:38:19.682 INFO:teuthology.orchestra.run.smithi060.stdout:(33/33): librbd1-19.3.0-4975.g1889a165.el9.x86_ 12 MB/s | 3.3 MB 00:00 2024-09-17T16:38:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:19.687 INFO:teuthology.orchestra.run.smithi060.stdout:Total 23 MB/s | 62 MB 00:02 2024-09-17T16:38:19.798 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:38:19.831 INFO:teuthology.orchestra.run.smithi183.stdout:(3/33): libcephfs2-19.3.0-4975.g1889a165.el9.x8 4.2 MB/s | 756 kB 00:00 2024-09-17T16:38:19.839 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:38:19.839 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:38:19.964 INFO:teuthology.orchestra.run.smithi183.stdout:(4/33): libradosstriper1-19.3.0-4975.g1889a165. 3.7 MB/s | 508 kB 00:00 2024-09-17T16:38:20.532 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:38:20.532 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:38:20.640 INFO:teuthology.orchestra.run.smithi183.stdout:(5/33): ceph-radosgw-19.3.0-4975.g1889a165.el9. 4.0 MB/s | 11 MB 00:02 2024-09-17T16:38:20.681 INFO:teuthology.orchestra.run.smithi183.stdout:(6/33): python3-ceph-argparse-19.3.0-4975.g1889 1.1 MB/s | 45 kB 00:00 2024-09-17T16:38:20.749 INFO:teuthology.orchestra.run.smithi183.stdout:(7/33): python3-ceph-common-19.3.0-4975.g1889a1 2.1 MB/s | 143 kB 00:00 2024-09-17T16:38:20.749 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /root 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2024-09-17T16:38:20.750 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:20.816 INFO:teuthology.orchestra.run.smithi183.stdout:(8/33): python3-cephfs-19.3.0-4975.g1889a165.el 2.4 MB/s | 161 kB 00:00 2024-09-17T16:38:20.908 INFO:teuthology.orchestra.run.smithi183.stdout:(9/33): python3-rados-19.3.0-4975.g1889a165.el9 3.4 MB/s | 321 kB 00:00 2024-09-17T16:38:20.942 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:38:20.999 INFO:teuthology.orchestra.run.smithi183.stdout:(10/33): librgw2-19.3.0-4975.g1889a165.el9.x86_ 5.3 MB/s | 5.5 MB 00:01 2024-09-17T16:38:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-17T16:38:21.033 INFO:teuthology.orchestra.run.smithi183.stdout:(11/33): python3-rbd-19.3.0-4975.g1889a165.el9. 2.4 MB/s | 305 kB 00:00 2024-09-17T16:38:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-17T16:38:21.058 INFO:teuthology.orchestra.run.smithi183.stdout:(12/33): python3-rgw-19.3.0-4975.g1889a165.el9. 1.7 MB/s | 99 kB 00:00 2024-09-17T16:38:21.073 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-17T16:38:21.095 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:21.118 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:21.175 INFO:teuthology.orchestra.run.smithi183.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 754 kB/s | 107 kB 00:00 2024-09-17T16:38:21.209 INFO:teuthology.orchestra.run.smithi183.stdout:(14/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-17T16:38:21.251 INFO:teuthology.orchestra.run.smithi183.stdout:(15/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-17T16:38:21.276 INFO:teuthology.orchestra.run.smithi183.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-09-17T16:38:21.324 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:21.343 INFO:teuthology.orchestra.run.smithi183.stdout:(17/33): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-17T16:38:21.369 INFO:teuthology.orchestra.run.smithi183.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-17T16:38:21.377 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:21.394 INFO:teuthology.orchestra.run.smithi183.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 837 kB/s | 42 kB 00:00 2024-09-17T16:38:21.419 INFO:teuthology.orchestra.run.smithi183.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T16:38:21.444 INFO:teuthology.orchestra.run.smithi183.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-17T16:38:21.470 INFO:teuthology.orchestra.run.smithi183.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-17T16:38:21.520 INFO:teuthology.orchestra.run.smithi183.stdout:(23/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-17T16:38:21.545 INFO:teuthology.orchestra.run.smithi183.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-17T16:38:21.571 INFO:teuthology.orchestra.run.smithi183.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T16:38:21.596 INFO:teuthology.orchestra.run.smithi183.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-17T16:38:21.646 INFO:teuthology.orchestra.run.smithi183.stdout:(27/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-17T16:38:21.680 INFO:teuthology.orchestra.run.smithi183.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-17T16:38:21.780 INFO:teuthology.orchestra.run.smithi183.stdout:(29/33): libarrow-9.0.0-11.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-17T16:38:21.784 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:21.796 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-17T16:38:21.810 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:21.811 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:21.811 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T16:38:21.811 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:21.811 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:21.811 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:21.813 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:21.822 INFO:teuthology.orchestra.run.smithi183.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-17T16:38:21.858 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:21.929 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:21.929 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:21.951 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:22.044 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 8/35 2024-09-17T16:38:22.068 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:22.093 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:38:22.131 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:22.159 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-17T16:38:22.166 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-17T16:38:22.202 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 11/35 2024-09-17T16:38:22.213 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-17T16:38:22.237 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-17T16:38:22.252 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:22.273 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:22.278 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:22.295 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:22.367 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:22.402 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-17T16:38:22.431 INFO:teuthology.orchestra.run.smithi183.stdout:(31/33): ceph-common-19.3.0-4975.g1889a165.el9. 4.8 MB/s | 22 MB 00:04 2024-09-17T16:38:22.471 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:22.498 INFO:teuthology.orchestra.run.smithi183.stdout:(32/33): librados2-19.3.0-4975.g1889a165.el9.x8 4.8 MB/s | 3.5 MB 00:00 2024-09-17T16:38:22.509 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-17T16:38:22.525 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:22.544 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-17T16:38:22.548 INFO:teuthology.orchestra.run.smithi183.stdout:(33/33): librbd1-19.3.0-4975.g1889a165.el9.x86_ 4.5 MB/s | 3.3 MB 00:00 2024-09-17T16:38:22.554 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:22.554 INFO:teuthology.orchestra.run.smithi183.stdout:Total 13 MB/s | 62 MB 00:04 2024-09-17T16:38:22.585 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-17T16:38:22.618 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-17T16:38:22.647 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-17T16:38:22.671 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:38:22.680 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:22.708 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:38:22.708 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:38:22.726 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-17T16:38:22.879 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-17T16:38:22.997 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:23.057 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-17T16:38:23.073 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:23.102 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 1/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 3/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 4/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 5/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 6/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 8/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 9/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 10/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 11/35 2024-09-17T16:38:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 13/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-17T16:38:23.148 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-17T16:38:23.149 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 34/35 2024-09-17T16:38:23.172 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 8/35 2024-09-17T16:38:23.184 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:23.198 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:23.215 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 24/35 2024-09-17T16:38:23.252 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-17T16:38:23.298 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:23.340 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-17T16:38:23.385 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 11/35 2024-09-17T16:38:23.413 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:38:23.413 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:38:23.456 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:23.484 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:23.532 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:23.566 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-17T16:38:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-17T16:38:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-17T16:38:23.745 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-17T16:38:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-17T16:38:23.771 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:23.799 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-17T16:38:23.826 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:23.828 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-17T16:38:23.861 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:23.898 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-17T16:38:23.904 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 28/35 2024-09-17T16:38:23.932 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 29/35 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.070 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.070 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.071 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T16:38:24.071 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T16:38:24.072 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T16:38:24.073 INFO:teuthology.orchestra.run.smithi111.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T16:38:24.074 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:24.074 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-17T16:38:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:24.392 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:24.405 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-test 2024-09-17T16:38:24.421 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 24/35 2024-09-17T16:38:24.458 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-17T16:38:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:38:24.977 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-17T16:38:24.978 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:25.010 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:25.030 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-17T16:38:25.061 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-17T16:38:25.082 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-17T16:38:25.108 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:19.3.0-4975.g1889a165.el9 ceph 46 M 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:19.3.0-4975.g1889a165.el9 ceph 162 k 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T16:38:25.109 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout:Install 4 Packages 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 46 M 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 201 M 2024-09-17T16:38:25.110 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:38:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-17T16:38:25.163 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 28/35 2024-09-17T16:38:25.204 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 29/35 2024-09-17T16:38:25.328 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:25.368 INFO:teuthology.orchestra.run.smithi111.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-17T16:38:25.381 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-17T16:38:25.410 INFO:teuthology.orchestra.run.smithi111.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-17T16:38:25.468 INFO:teuthology.orchestra.run.smithi111.stdout:(3/4): libcephsqlite-19.3.0-4975.g1889a165.el9. 702 kB/s | 162 kB 00:00 2024-09-17T16:38:25.770 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-17T16:38:25.838 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:25.939 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:26.034 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 8/35 2024-09-17T16:38:26.065 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:26.128 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 9/35 2024-09-17T16:38:26.165 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-17T16:38:26.208 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 11/35 2024-09-17T16:38:26.277 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:26.292 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:26.300 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:26.328 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:26.364 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 13/35 2024-09-17T16:38:26.398 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-17T16:38:26.515 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-17T16:38:26.567 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-17T16:38:26.616 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-17T16:38:26.657 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-17T16:38:26.668 INFO:teuthology.orchestra.run.smithi111.stdout:(4/4): ceph-test-19.3.0-4975.g1889a165.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-17T16:38:26.671 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:26.671 INFO:teuthology.orchestra.run.smithi111.stdout:Total 29 MB/s | 46 MB 00:01 2024-09-17T16:38:26.686 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-17T16:38:26.699 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:38:26.720 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:38:26.720 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:38:26.726 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:26.764 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-17T16:38:26.898 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:26.941 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:27.027 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:27.027 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T16:38:27.028 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T16:38:27.028 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:27.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:27.087 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-17T16:38:27.101 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:38:27.101 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:38:27.133 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:27.223 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 23/35 2024-09-17T16:38:27.254 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 24/35 2024-09-17T16:38:27.290 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-17T16:38:27.608 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:38:27.673 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:27.694 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T16:38:27.709 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:27.748 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T16:38:27.778 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:27.788 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-17T16:38:27.819 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:27.891 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 27/35 2024-09-17T16:38:27.968 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 28/35 2024-09-17T16:38:28.004 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 29/35 2024-09-17T16:38:28.318 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:28.354 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:28.446 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:28.446 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T16:38:28.446 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T16:38:28.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:28.480 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:30.346 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:30.955 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 30/35 2024-09-17T16:38:30.996 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:31.085 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 31/35 2024-09-17T16:38:31.086 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T16:38:31.086 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T16:38:31.086 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:31.113 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:32.173 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:32.268 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:34.604 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:34.604 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 1/4 2024-09-17T16:38:34.604 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2/4 2024-09-17T16:38:34.604 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T16:38:34.966 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T16:38:34.966 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:34.967 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:35.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph 2024-09-17T16:38:35.850 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:35.991 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:35.993 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:19.3.0-4975.g1889a165.el9 ceph 6.6 k 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:19.3.0-4975.g1889a165.el9 ceph 2.4 M 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:19.3.0-4975.g1889a165.el9 ceph 1.5 M 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 291 k 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:19.3.0-4975.g1889a165.el9 ceph 4.8 M 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 17 M 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T16:38:35.994 INFO:teuthology.orchestra.run.smithi111.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T16:38:35.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T16:38:35.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout:Install 37 Packages 2024-09-17T16:38:35.997 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:35.998 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 31 M 2024-09-17T16:38:35.998 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 109 M 2024-09-17T16:38:35.998 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:38:36.581 INFO:teuthology.orchestra.run.smithi111.stdout:(1/37): ceph-19.3.0-4975.g1889a165.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-17T16:38:36.739 INFO:teuthology.orchestra.run.smithi111.stdout:(2/37): ceph-mgr-19.3.0-4975.g1889a165.el9.x86_ 5.4 MB/s | 1.5 MB 00:00 2024-09-17T16:38:36.815 INFO:teuthology.orchestra.run.smithi111.stdout:(3/37): ceph-mds-19.3.0-4975.g1889a165.el9.x86_ 6.6 MB/s | 2.4 MB 00:00 2024-09-17T16:38:36.915 INFO:teuthology.orchestra.run.smithi111.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4975.g1889 2.8 MB/s | 291 kB 00:00 2024-09-17T16:38:36.990 INFO:teuthology.orchestra.run.smithi111.stdout:(5/37): ceph-mon-19.3.0-4975.g1889a165.el9.x86_ 12 MB/s | 4.8 MB 00:00 2024-09-17T16:38:37.157 INFO:teuthology.orchestra.run.smithi111.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-09-17T16:38:37.259 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:37.259 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-17T16:38:37.259 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-17T16:38:37.259 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-17T16:38:37.259 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-17T16:38:37.259 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-17T16:38:37.260 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-17T16:38:37.260 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-17T16:38:37.260 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:37.357 INFO:teuthology.orchestra.run.smithi111.stdout:(7/37): ceph-osd-19.3.0-4975.g1889a165.el9.x86_ 28 MB/s | 17 MB 00:00 2024-09-17T16:38:37.383 INFO:teuthology.orchestra.run.smithi111.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 473 kB/s | 106 kB 00:00 2024-09-17T16:38:37.442 INFO:teuthology.orchestra.run.smithi111.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-17T16:38:37.483 INFO:teuthology.orchestra.run.smithi111.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-17T16:38:37.534 INFO:teuthology.orchestra.run.smithi111.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-17T16:38:37.559 INFO:teuthology.orchestra.run.smithi111.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 672 kB/s | 135 kB 00:00 2024-09-17T16:38:38.109 INFO:teuthology.orchestra.run.smithi111.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 63 kB/s | 35 kB 00:00 2024-09-17T16:38:38.221 INFO:teuthology.orchestra.run.smithi111.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-09-17T16:38:38.251 INFO:teuthology.orchestra.run.smithi111.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 240 kB/s | 172 kB 00:00 2024-09-17T16:38:38.263 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:38.289 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:38.289 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:38.289 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T16:38:38.289 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:38.289 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:38.289 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:38.291 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:38.399 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:38.399 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:38.793 INFO:teuthology.orchestra.run.smithi111.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 113 kB/s | 77 kB 00:00 2024-09-17T16:38:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 68 kB/s | 42 kB 00:00 2024-09-17T16:38:38.885 INFO:teuthology.orchestra.run.smithi111.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 76 kB/s | 51 kB 00:00 2024-09-17T16:38:38.927 INFO:teuthology.orchestra.run.smithi111.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-17T16:38:38.953 INFO:teuthology.orchestra.run.smithi111.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 650 kB/s | 43 kB 00:00 2024-09-17T16:38:38.978 INFO:teuthology.orchestra.run.smithi111.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2024-09-17T16:38:39.003 INFO:teuthology.orchestra.run.smithi111.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-09-17T16:38:39.028 INFO:teuthology.orchestra.run.smithi111.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 711 kB/s | 18 kB 00:00 2024-09-17T16:38:39.054 INFO:teuthology.orchestra.run.smithi111.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 933 kB/s | 23 kB 00:00 2024-09-17T16:38:39.077 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:39.077 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-17T16:38:39.077 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-17T16:38:39.077 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-17T16:38:39.077 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-17T16:38:39.077 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-17T16:38:39.078 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-17T16:38:39.078 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-17T16:38:39.078 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:39.087 INFO:teuthology.orchestra.run.smithi111.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 751 kB/s | 19 kB 00:00 2024-09-17T16:38:39.113 INFO:teuthology.orchestra.run.smithi111.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.2 MB/s | 358 kB 00:00 2024-09-17T16:38:39.138 INFO:teuthology.orchestra.run.smithi111.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-17T16:38:39.163 INFO:teuthology.orchestra.run.smithi111.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-17T16:38:39.188 INFO:teuthology.orchestra.run.smithi111.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.6 MB/s | 79 kB 00:00 2024-09-17T16:38:39.214 INFO:teuthology.orchestra.run.smithi111.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 657 kB/s | 16 kB 00:00 2024-09-17T16:38:39.239 INFO:teuthology.orchestra.run.smithi111.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.6 MB/s | 90 kB 00:00 2024-09-17T16:38:39.264 INFO:teuthology.orchestra.run.smithi111.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-17T16:38:39.290 INFO:teuthology.orchestra.run.smithi111.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-17T16:38:39.331 INFO:teuthology.orchestra.run.smithi111.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-17T16:38:39.356 INFO:teuthology.orchestra.run.smithi111.stdout:(35/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.3 MB/s | 427 kB 00:00 2024-09-17T16:38:39.382 INFO:teuthology.orchestra.run.smithi111.stdout:(36/37): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-09-17T16:38:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:(37/37): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2024-09-17T16:38:39.412 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:39.413 INFO:teuthology.orchestra.run.smithi111.stdout:Total 9.0 MB/s | 31 MB 00:03 2024-09-17T16:38:39.567 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:38:39.608 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:38:39.608 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:38:39.634 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:39.634 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 1/35 2024-09-17T16:38:39.634 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2/35 2024-09-17T16:38:39.634 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 3/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 4/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 5/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 6/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 8/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 9/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 10/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 11/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 13/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-17T16:38:39.635 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-17T16:38:39.636 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-17T16:38:39.637 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-17T16:38:39.637 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-17T16:38:39.637 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:39.637 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-17T16:38:39.637 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 34/35 2024-09-17T16:38:40.073 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:38:40.074 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:38:40.114 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:40.140 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:40.140 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:40.140 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T16:38:40.140 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:40.140 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:40.140 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:40.142 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:40.225 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:40.225 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:40.631 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:40.631 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:40.631 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-17T16:38:40.631 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.631 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.631 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.632 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.633 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:40.634 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:38:41.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-test 2024-09-17T16:38:41.313 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:41.313 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-09-17T16:38:41.314 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:41.423 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:38:41.485 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T16:38:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 1/35 2024-09-17T16:38:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2/35 2024-09-17T16:38:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 3/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 4/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 5/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 6/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 8/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 9/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 10/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 11/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 13/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-17T16:38:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-17T16:38:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-17T16:38:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-17T16:38:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-17T16:38:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-17T16:38:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 34/35 2024-09-17T16:38:41.529 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T16:38:41.563 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T16:38:41.572 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:38:41.634 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T16:38:41.678 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T16:38:41.711 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T16:38:41.714 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:38:41.715 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:41.715 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:38:41.715 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:41.715 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-4975.g1889a165.el9 ceph 46 M 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-4975.g1889a165.el9 ceph 162 k 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout:Install 4 Packages 2024-09-17T16:38:41.716 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:41.717 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 46 M 2024-09-17T16:38:41.717 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 201 M 2024-09-17T16:38:41.717 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:38:41.803 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T16:38:41.890 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T16:38:41.932 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T16:38:41.966 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T16:38:41.996 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T16:38:42.030 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T16:38:42.064 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T16:38:42.105 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T16:38:42.148 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T16:38:42.182 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T16:38:42.188 INFO:teuthology.orchestra.run.smithi098.stdout:(1/4): libcephsqlite-19.3.0-4975.g1889a165.el9. 758 kB/s | 162 kB 00:00 2024-09-17T16:38:42.239 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T16:38:42.280 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T16:38:42.332 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:42.352 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T16:38:42.358 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 33/35 2024-09-17T16:38:42.358 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:42.358 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T16:38:42.358 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:42.358 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T16:38:42.359 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:42.360 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T16:38:42.410 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T16:38:42.411 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:42.412 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T16:38:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T16:38:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T16:38:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T16:38:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T16:38:42.413 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:42.413 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:38:42.451 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-17T16:38:42.452 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:42.491 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T16:38:42.570 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T16:38:42.623 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T16:38:42.670 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T16:38:42.727 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T16:38:42.783 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T16:38:42.814 INFO:teuthology.orchestra.run.smithi098.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-17T16:38:42.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-test 2024-09-17T16:38:42.922 INFO:teuthology.orchestra.run.smithi098.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 321 kB/s | 304 kB 00:00 2024-09-17T16:38:42.969 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T16:38:43.033 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T16:38:43.120 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T16:38:43.233 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T16:38:43.265 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T16:38:43.393 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T16:38:43.397 INFO:teuthology.orchestra.run.smithi098.stdout:(4/4): ceph-test-19.3.0-4975.g1889a165.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-17T16:38:43.400 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:43.400 INFO:teuthology.orchestra.run.smithi098.stdout:Total 27 MB/s | 46 MB 00:01 2024-09-17T16:38:43.427 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:38:43.447 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:38:43.447 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:38:43.504 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:38:43.556 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 32/37 2024-09-17T16:38:43.584 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:38:43.610 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:38:43.610 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:43.610 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T16:38:43.610 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:38:43.611 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:38:43.611 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:43.640 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.3.0-4975.g1889a165.el9 ceph 46 M 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.3.0-4975.g1889a165.el9 ceph 162 k 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:38:43.641 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:43.642 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-17T16:38:43.642 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:43.642 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 46 M 2024-09-17T16:38:43.642 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 201 M 2024-09-17T16:38:43.642 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 1/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 3/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 4/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 5/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_6 6/35 2024-09-17T16:38:43.719 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 7/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9. 8/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x8 9/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 10/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 11/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 12/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 13/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-17T16:38:43.720 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-17T16:38:43.721 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.3.0-4975.g1889a165.el9.x86_64 32/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-17T16:38:43.722 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 34/35 2024-09-17T16:38:43.831 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:38:43.831 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:38:43.913 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): libcephsqlite-19.3.0-4975.g1889a165.el9. 725 kB/s | 162 kB 00:00 2024-09-17T16:38:43.938 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-17T16:38:44.055 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-17T16:38:44.331 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:38:44.406 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T16:38:44.455 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T16:38:44.483 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:44.643 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-17T16:38:44.643 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:44.643 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-09-17T16:38:44.643 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.643 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.643 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T16:38:44.644 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.645 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:44.646 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:38:45.016 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-test 2024-09-17T16:38:45.077 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:38:45.105 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:38:45.105 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:45.105 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T16:38:45.106 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:38:45.106 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:38:45.106 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:45.578 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:38:45.588 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:38:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:38:45.602 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:45.602 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T16:38:45.602 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:38:45.602 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:38:45.602 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:45.639 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): ceph-test-19.3.0-4975.g1889a165.el9.x86_ 23 MB/s | 46 MB 00:01 2024-09-17T16:38:45.641 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:45.641 INFO:teuthology.orchestra.run.smithi060.stdout:Total 23 MB/s | 46 MB 00:01 2024-09-17T16:38:45.670 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:38:45.693 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:38:45.693 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:38:45.718 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:38:45.719 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:45.719 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:38:45.719 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:45.719 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:38:45.719 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.3.0-4975.g1889a165.el9 ceph 46 M 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.3.0-4975.g1889a165.el9 ceph 162 k 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout:Install 4 Packages 2024-09-17T16:38:45.720 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:45.721 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 46 M 2024-09-17T16:38:45.721 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 201 M 2024-09-17T16:38:45.721 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:38:45.828 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:38:45.852 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:38:45.853 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:45.853 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T16:38:45.853 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:38:45.853 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:38:45.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:45.917 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:38:45.973 INFO:teuthology.orchestra.run.smithi183.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-17T16:38:46.009 INFO:teuthology.orchestra.run.smithi183.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-17T16:38:46.082 INFO:teuthology.orchestra.run.smithi183.stdout:(3/4): libcephsqlite-19.3.0-4975.g1889a165.el9. 687 kB/s | 162 kB 00:00 2024-09-17T16:38:46.087 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:38:46.087 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:38:46.759 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:38:46.832 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T16:38:46.881 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T16:38:46.907 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:47.274 INFO:teuthology.orchestra.run.smithi183.stdout:(4/4): ceph-test-19.3.0-4975.g1889a165.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-17T16:38:47.276 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:47.276 INFO:teuthology.orchestra.run.smithi183.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-17T16:38:47.304 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:38:47.324 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:38:47.324 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:38:47.596 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:38:47.596 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 1/37 2024-09-17T16:38:47.596 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2/37 2024-09-17T16:38:47.596 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 3/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 4/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 5/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 6/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T16:38:47.597 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T16:38:47.598 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T16:38:47.599 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T16:38:47.599 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T16:38:47.599 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T16:38:47.599 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T16:38:47.599 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T16:38:47.601 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T16:38:47.601 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T16:38:47.601 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T16:38:47.601 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T16:38:47.602 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T16:38:47.700 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:38:47.700 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:38:48.206 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:38:48.291 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T16:38:48.333 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T16:38:48.359 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T16:38:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:48.589 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:38:48.589 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T16:38:48.590 INFO:teuthology.orchestra.run.smithi111.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T16:38:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T16:38:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T16:38:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T16:38:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T16:38:48.591 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T16:38:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T16:38:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T16:38:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T16:38:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T16:38:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T16:38:48.592 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T16:38:48.593 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T16:38:48.594 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T16:38:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T16:38:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T16:38:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T16:38:48.595 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:48.595 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:48.816 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:48.906 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:48.974 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-base 2024-09-17T16:38:49.576 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:49.665 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:38:49.707 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:49.708 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:38:49.708 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:49.772 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install cephadm 2024-09-17T16:38:50.364 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:50.505 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 784 k 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:50.506 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:38:50.507 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:50.507 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 784 k 2024-09-17T16:38:50.507 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 791 k 2024-09-17T16:38:50.507 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:38:50.761 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm-19.3.0-4975.g1889a165.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-17T16:38:50.762 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:50.762 INFO:teuthology.orchestra.run.smithi111.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-17T16:38:50.762 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:38:50.768 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:38:50.768 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:38:50.774 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:38:50.775 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:38:50.847 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:38:51.222 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:51.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 1/4 2024-09-17T16:38:51.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2/4 2024-09-17T16:38:51.222 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T16:38:51.289 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:38:51.366 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:38:51.559 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:51.571 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:51.572 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:38:51.634 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:51.712 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:38:51.900 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph 2024-09-17T16:38:51.970 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:38:51.970 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:51.970 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:38:51.970 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:38:51.970 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:51.970 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:52.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T16:38:52.502 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:38:52.644 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:38:52.647 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:38:52.647 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:52.647 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:38:52.647 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-4975.g1889a165.el9 ceph 6.6 k 2024-09-17T16:38:52.647 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-4975.g1889a165.el9 ceph 2.4 M 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-4975.g1889a165.el9 ceph 1.5 M 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 291 k 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-4975.g1889a165.el9 ceph 4.8 M 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 17 M 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T16:38:52.648 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T16:38:52.649 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T16:38:52.650 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:38:52.651 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:38:52.652 INFO:teuthology.orchestra.run.smithi098.stdout:Install 37 Packages 2024-09-17T16:38:52.652 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:38:52.652 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 31 M 2024-09-17T16:38:52.652 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 109 M 2024-09-17T16:38:52.652 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:38:52.739 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 3/4 2024-09-17T16:38:52.745 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:52.832 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:52.879 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4975.g1889a165.el9 ceph 145 k 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 145 k 2024-09-17T16:38:52.880 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 432 k 2024-09-17T16:38:52.881 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:38:53.075 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-immutable-object-cache-19.3.0-4975.g1889a1 745 kB/s | 145 kB 00:00 2024-09-17T16:38:53.076 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:53.076 INFO:teuthology.orchestra.run.smithi111.stdout:Total 739 kB/s | 145 kB 00:00 2024-09-17T16:38:53.076 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:38:53.083 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:38:53.083 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:38:53.140 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:38:53.140 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:38:53.288 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:38:53.333 INFO:teuthology.orchestra.run.smithi098.stdout:(1/37): ceph-19.3.0-4975.g1889a165.el9.x86_64.r 54 kB/s | 6.6 kB 00:00 2024-09-17T16:38:53.351 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:38:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:38:53.376 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:38:53.376 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T16:38:53.376 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:53.508 INFO:teuthology.orchestra.run.smithi098.stdout:(2/37): ceph-mgr-19.3.0-4975.g1889a165.el9.x86_ 5.1 MB/s | 1.5 MB 00:00 2024-09-17T16:38:53.583 INFO:teuthology.orchestra.run.smithi098.stdout:(3/37): ceph-mds-19.3.0-4975.g1889a165.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-09-17T16:38:53.676 INFO:teuthology.orchestra.run.smithi098.stdout:(4/37): ceph-mon-19.3.0-4975.g1889a165.el9.x86_ 14 MB/s | 4.8 MB 00:00 2024-09-17T16:38:53.701 INFO:teuthology.orchestra.run.smithi098.stdout:(5/37): ceph-mgr-modules-core-19.3.0-4975.g1889 2.4 MB/s | 291 kB 00:00 2024-09-17T16:38:54.076 INFO:teuthology.orchestra.run.smithi098.stdout:(6/37): ceph-osd-19.3.0-4975.g1889a165.el9.x86_ 30 MB/s | 17 MB 00:00 2024-09-17T16:38:54.287 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:54.287 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 1/4 2024-09-17T16:38:54.287 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2/4 2024-09-17T16:38:54.287 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T16:38:54.320 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:38:54.320 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:54.320 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:38:54.320 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:54.320 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:54.320 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:54.550 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr 2024-09-17T16:38:54.597 INFO:teuthology.orchestra.run.smithi098.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 276 kB/s | 253 kB 00:00 2024-09-17T16:38:54.630 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T16:38:54.630 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:54.630 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:38:54.630 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:54.630 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:54.630 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T16:38:54.631 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T16:38:54.631 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:54.631 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:38:54.743 INFO:teuthology.orchestra.run.smithi098.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-17T16:38:54.860 INFO:teuthology.orchestra.run.smithi098.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-17T16:38:54.902 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph 2024-09-17T16:38:55.149 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:55.150 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 4/4 2024-09-17T16:38:55.150 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 1/4 2024-09-17T16:38:55.150 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2/4 2024-09-17T16:38:55.150 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T16:38:55.239 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:38:55.281 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:55.282 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:38:55.282 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:38:55.285 INFO:teuthology.orchestra.run.smithi098.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 195 kB/s | 135 kB 00:00 2024-09-17T16:38:55.342 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T16:38:55.444 INFO:teuthology.orchestra.run.smithi098.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 178 kB/s | 125 kB 00:00 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T16:38:55.462 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:55.463 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:38:55.486 INFO:teuthology.orchestra.run.smithi098.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 943 kB/s | 188 kB 00:00 2024-09-17T16:38:55.505 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:38:55.528 INFO:teuthology.orchestra.run.smithi098.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 838 kB/s | 35 kB 00:00 2024-09-17T16:38:55.578 INFO:teuthology.orchestra.run.smithi098.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-17T16:38:55.603 INFO:teuthology.orchestra.run.smithi098.stdout:(15/37): python3-urllib3-1.26.5-6.el9.noarch.rp 289 kB/s | 215 kB 00:00 2024-09-17T16:38:55.620 INFO:teuthology.orchestra.run.smithi098.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-17T16:38:55.647 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.3.0-4975.g1889a165.el9 ceph 6.6 k 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.3.0-4975.g1889a165.el9 ceph 2.4 M 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.3.0-4975.g1889a165.el9 ceph 1.5 M 2024-09-17T16:38:55.650 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 291 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.3.0-4975.g1889a165.el9 ceph 4.8 M 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 17 M 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T16:38:55.651 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T16:38:55.652 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T16:38:55.653 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T16:38:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T16:38:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:38:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:38:55.654 INFO:teuthology.orchestra.run.smithi060.stdout:Install 37 Packages 2024-09-17T16:38:55.654 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:38:55.655 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 31 M 2024-09-17T16:38:55.655 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 109 M 2024-09-17T16:38:55.655 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:38:55.658 INFO:teuthology.orchestra.run.smithi098.stdout:(17/37): python3-mako-1.1.4-6.el9.noarch.rpm 808 kB/s | 172 kB 00:00 2024-09-17T16:38:55.699 INFO:teuthology.orchestra.run.smithi098.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-17T16:38:55.725 INFO:teuthology.orchestra.run.smithi098.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-17T16:38:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 184 kB/s | 22 kB 00:00 2024-09-17T16:38:55.758 INFO:teuthology.orchestra.run.smithi098.stdout:(21/37): python3-toml-0.10.2-6.el9.noarch.rpm 269 kB/s | 42 kB 00:00 2024-09-17T16:38:55.778 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph 2024-09-17T16:38:55.792 INFO:teuthology.orchestra.run.smithi098.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-09-17T16:38:55.821 INFO:teuthology.orchestra.run.smithi098.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.1 MB/s | 18 kB 00:00 2024-09-17T16:38:55.835 INFO:teuthology.orchestra.run.smithi098.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 155 kB/s | 11 kB 00:00 2024-09-17T16:38:55.851 INFO:teuthology.orchestra.run.smithi098.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 733 kB/s | 23 kB 00:00 2024-09-17T16:38:55.869 INFO:teuthology.orchestra.run.smithi098.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 1.1 MB/s | 19 kB 00:00 2024-09-17T16:38:55.885 INFO:teuthology.orchestra.run.smithi098.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 588 kB/s | 20 kB 00:00 2024-09-17T16:38:55.902 INFO:teuthology.orchestra.run.smithi098.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-17T16:38:55.911 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:38:55.928 INFO:teuthology.orchestra.run.smithi098.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.9 MB/s | 358 kB 00:00 2024-09-17T16:38:55.953 INFO:teuthology.orchestra.run.smithi098.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-17T16:38:55.970 INFO:teuthology.orchestra.run.smithi098.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 394 kB/s | 16 kB 00:00 2024-09-17T16:38:55.995 INFO:teuthology.orchestra.run.smithi098.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-17T16:38:56.012 INFO:teuthology.orchestra.run.smithi098.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 853 kB/s | 36 kB 00:00 2024-09-17T16:38:56.037 INFO:teuthology.orchestra.run.smithi098.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-17T16:38:56.044 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:38:56.045 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:38:56.045 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:56.045 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:38:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 14 M 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 34 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 16 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T16:38:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:56.047 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:38:56.047 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:38:56.047 INFO:teuthology.orchestra.run.smithi111.stdout:Install 12 Packages 2024-09-17T16:38:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:38:56.047 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 19 M 2024-09-17T16:38:56.047 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 159 M 2024-09-17T16:38:56.048 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:38:56.062 INFO:teuthology.orchestra.run.smithi098.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-17T16:38:56.088 INFO:teuthology.orchestra.run.smithi098.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-17T16:38:56.113 INFO:teuthology.orchestra.run.smithi098.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-17T16:38:56.117 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:56.117 INFO:teuthology.orchestra.run.smithi098.stdout:Total 8.9 MB/s | 31 MB 00:03 2024-09-17T16:38:56.215 INFO:teuthology.orchestra.run.smithi060.stdout:(1/37): ceph-19.3.0-4975.g1889a165.el9.x86_64.r 58 kB/s | 6.6 kB 00:00 2024-09-17T16:38:56.261 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:38:56.301 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:38:56.382 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:38:56.430 INFO:teuthology.orchestra.run.smithi111.stdout:(1/12): ceph-prometheus-alerts-19.3.0-4975.g188 101 kB/s | 16 kB 00:00 2024-09-17T16:38:56.431 INFO:teuthology.orchestra.run.smithi060.stdout:(2/37): ceph-mds-19.3.0-4975.g1889a165.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-17T16:38:56.447 INFO:teuthology.orchestra.run.smithi111.stdout:(2/12): ceph-grafana-dashboards-19.3.0-4975.g18 190 kB/s | 34 kB 00:00 2024-09-17T16:38:56.473 INFO:teuthology.orchestra.run.smithi060.stdout:(3/37): ceph-mgr-19.3.0-4975.g1889a165.el9.x86_ 4.1 MB/s | 1.5 MB 00:00 2024-09-17T16:38:56.525 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:38:56.527 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:56.527 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:38:56.527 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:56.527 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.3.0-4975.g1889a165.el9 ceph 6.6 k 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.3.0-4975.g1889a165.el9 ceph 2.4 M 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.3.0-4975.g1889a165.el9 ceph 1.5 M 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 291 k 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.3.0-4975.g1889a165.el9 ceph 4.8 M 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 17 M 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T16:38:56.528 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T16:38:56.529 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T16:38:56.530 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout:Install 37 Packages 2024-09-17T16:38:56.531 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:38:56.532 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 31 M 2024-09-17T16:38:56.532 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 109 M 2024-09-17T16:38:56.532 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:38:56.582 INFO:teuthology.orchestra.run.smithi060.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4975.g1889 2.6 MB/s | 291 kB 00:00 2024-09-17T16:38:56.691 INFO:teuthology.orchestra.run.smithi060.stdout:(5/37): ceph-mon-19.3.0-4975.g1889a165.el9.x86_ 10 MB/s | 4.8 MB 00:00 2024-09-17T16:38:56.766 INFO:teuthology.orchestra.run.smithi060.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-17T16:38:56.804 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:38:56.804 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:38:56.817 INFO:teuthology.orchestra.run.smithi060.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-17T16:38:56.858 INFO:teuthology.orchestra.run.smithi060.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-17T16:38:57.025 INFO:teuthology.orchestra.run.smithi183.stdout:(1/37): ceph-19.3.0-4975.g1889a165.el9.x86_64.r 58 kB/s | 6.6 kB 00:00 2024-09-17T16:38:57.034 INFO:teuthology.orchestra.run.smithi060.stdout:(9/37): ceph-osd-19.3.0-4975.g1889a165.el9.x86_ 29 MB/s | 17 MB 00:00 2024-09-17T16:38:57.059 INFO:teuthology.orchestra.run.smithi060.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 624 kB/s | 125 kB 00:00 2024-09-17T16:38:57.092 INFO:teuthology.orchestra.run.smithi060.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2024-09-17T16:38:57.172 INFO:teuthology.orchestra.run.smithi111.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 371 kB/s | 269 kB 00:00 2024-09-17T16:38:57.176 INFO:teuthology.orchestra.run.smithi060.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-09-17T16:38:57.234 INFO:teuthology.orchestra.run.smithi183.stdout:(2/37): ceph-mgr-19.3.0-4975.g1889a165.el9.x86_ 4.7 MB/s | 1.5 MB 00:00 2024-09-17T16:38:57.285 INFO:teuthology.orchestra.run.smithi183.stdout:(3/37): ceph-mds-19.3.0-4975.g1889a165.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-09-17T16:38:57.377 INFO:teuthology.orchestra.run.smithi183.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4975.g1889 3.1 MB/s | 291 kB 00:00 2024-09-17T16:38:57.390 INFO:teuthology.orchestra.run.smithi111.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-17T16:38:57.440 INFO:teuthology.orchestra.run.smithi111.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-17T16:38:57.465 INFO:teuthology.orchestra.run.smithi111.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-17T16:38:57.499 INFO:teuthology.orchestra.run.smithi111.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.6 MB/s | 863 kB 00:00 2024-09-17T16:38:57.543 INFO:teuthology.orchestra.run.smithi183.stdout:(5/37): ceph-mon-19.3.0-4975.g1889a165.el9.x86_ 9.3 MB/s | 4.8 MB 00:00 2024-09-17T16:38:57.657 INFO:teuthology.orchestra.run.smithi111.stdout:(8/12): ceph-mgr-dashboard-19.3.0-4975.g1889a16 10 MB/s | 14 MB 00:01 2024-09-17T16:38:57.669 INFO:teuthology.orchestra.run.smithi183.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-09-17T16:38:57.716 INFO:teuthology.orchestra.run.smithi111.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 666 kB/s | 144 kB 00:00 2024-09-17T16:38:57.766 INFO:teuthology.orchestra.run.smithi111.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 304 kB/s | 31 kB 00:00 2024-09-17T16:38:57.768 INFO:teuthology.orchestra.run.smithi060.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 59 kB/s | 35 kB 00:00 2024-09-17T16:38:57.791 INFO:teuthology.orchestra.run.smithi111.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-17T16:38:57.827 INFO:teuthology.orchestra.run.smithi060.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-09-17T16:38:57.833 INFO:teuthology.orchestra.run.smithi111.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.5 MB/s | 2.0 MB 00:00 2024-09-17T16:38:57.837 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:57.837 INFO:teuthology.orchestra.run.smithi111.stdout:Total 11 MB/s | 19 MB 00:01 2024-09-17T16:38:57.861 INFO:teuthology.orchestra.run.smithi183.stdout:(7/37): ceph-osd-19.3.0-4975.g1889a165.el9.x86_ 27 MB/s | 17 MB 00:00 2024-09-17T16:38:57.885 INFO:teuthology.orchestra.run.smithi060.stdout:(15/37): lua-5.4.4-4.el9.x86_64.rpm 228 kB/s | 188 kB 00:00 2024-09-17T16:38:57.886 INFO:teuthology.orchestra.run.smithi183.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 491 kB/s | 106 kB 00:00 2024-09-17T16:38:57.886 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:38:57.904 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:38:57.904 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:38:57.936 INFO:teuthology.orchestra.run.smithi183.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-17T16:38:57.995 INFO:teuthology.orchestra.run.smithi183.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-17T16:38:58.028 INFO:teuthology.orchestra.run.smithi183.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 808 kB/s | 135 kB 00:00 2024-09-17T16:38:58.137 INFO:teuthology.orchestra.run.smithi183.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-09-17T16:38:58.169 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:38:58.170 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:38:58.171 INFO:teuthology.orchestra.run.smithi183.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2024-09-17T16:38:58.196 INFO:teuthology.orchestra.run.smithi183.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 593 kB/s | 35 kB 00:00 2024-09-17T16:38:58.221 INFO:teuthology.orchestra.run.smithi183.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-17T16:38:58.222 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:38:58.247 INFO:teuthology.orchestra.run.smithi183.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T16:38:58.272 INFO:teuthology.orchestra.run.smithi183.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-17T16:38:58.291 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T16:38:58.314 INFO:teuthology.orchestra.run.smithi183.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-17T16:38:58.324 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T16:38:58.339 INFO:teuthology.orchestra.run.smithi183.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-17T16:38:58.352 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T16:38:58.364 INFO:teuthology.orchestra.run.smithi183.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-17T16:38:58.398 INFO:teuthology.orchestra.run.smithi183.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-17T16:38:58.402 INFO:teuthology.orchestra.run.smithi060.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 122 kB/s | 77 kB 00:00 2024-09-17T16:38:58.415 INFO:teuthology.orchestra.run.smithi183.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 638 kB/s | 11 kB 00:00 2024-09-17T16:38:58.421 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T16:38:58.427 INFO:teuthology.orchestra.run.smithi060.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 85 kB/s | 51 kB 00:00 2024-09-17T16:38:58.432 INFO:teuthology.orchestra.run.smithi183.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-17T16:38:58.461 INFO:teuthology.orchestra.run.smithi183.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 809 kB/s | 23 kB 00:00 2024-09-17T16:38:58.461 INFO:teuthology.orchestra.run.smithi060.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 384 kB/s | 22 kB 00:00 2024-09-17T16:38:58.467 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T16:38:58.486 INFO:teuthology.orchestra.run.smithi183.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 779 kB/s | 19 kB 00:00 2024-09-17T16:38:58.490 INFO:teuthology.orchestra.run.smithi060.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 69 kB/s | 42 kB 00:00 2024-09-17T16:38:58.500 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T16:38:58.511 INFO:teuthology.orchestra.run.smithi183.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 785 kB/s | 20 kB 00:00 2024-09-17T16:38:58.531 INFO:teuthology.orchestra.run.smithi060.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-17T16:38:58.536 INFO:teuthology.orchestra.run.smithi183.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-17T16:38:58.557 INFO:teuthology.orchestra.run.smithi060.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 470 kB/s | 43 kB 00:00 2024-09-17T16:38:58.570 INFO:teuthology.orchestra.run.smithi183.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 2.9 MB/s | 79 kB 00:00 2024-09-17T16:38:58.574 INFO:teuthology.orchestra.run.smithi060.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 644 kB/s | 11 kB 00:00 2024-09-17T16:38:58.590 INFO:teuthology.orchestra.run.smithi060.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-17T16:38:58.592 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T16:38:58.595 INFO:teuthology.orchestra.run.smithi183.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-17T16:38:58.616 INFO:teuthology.orchestra.run.smithi060.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T16:38:58.620 INFO:teuthology.orchestra.run.smithi183.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-17T16:38:58.633 INFO:teuthology.orchestra.run.smithi060.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 553 kB/s | 23 kB 00:00 2024-09-17T16:38:58.650 INFO:teuthology.orchestra.run.smithi060.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 575 kB/s | 19 kB 00:00 2024-09-17T16:38:58.662 INFO:teuthology.orchestra.run.smithi183.stdout:(31/37): python3-cryptography-36.0.1-4.el9.x86_ 1.1 MB/s | 1.2 MB 00:01 2024-09-17T16:38:58.667 INFO:teuthology.orchestra.run.smithi060.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 582 kB/s | 20 kB 00:00 2024-09-17T16:38:58.669 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T16:38:58.684 INFO:teuthology.orchestra.run.smithi060.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-17T16:38:58.688 INFO:teuthology.orchestra.run.smithi183.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-17T16:38:58.709 INFO:teuthology.orchestra.run.smithi060.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.0 MB/s | 358 kB 00:00 2024-09-17T16:38:58.719 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T16:38:58.721 INFO:teuthology.orchestra.run.smithi183.stdout:(33/37): python3-webob-1.8.8-2.el9.noarch.rpm 8.4 MB/s | 230 kB 00:00 2024-09-17T16:38:58.734 INFO:teuthology.orchestra.run.smithi060.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-09-17T16:38:58.747 INFO:teuthology.orchestra.run.smithi183.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 426 kB/s | 36 kB 00:00 2024-09-17T16:38:58.751 INFO:teuthology.orchestra.run.smithi060.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 393 kB/s | 16 kB 00:00 2024-09-17T16:38:58.754 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T16:38:58.757 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:38:58.768 INFO:teuthology.orchestra.run.smithi060.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-17T16:38:58.772 INFO:teuthology.orchestra.run.smithi183.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 795 kB/s | 20 kB 00:00 2024-09-17T16:38:58.784 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T16:38:58.793 INFO:teuthology.orchestra.run.smithi060.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-17T16:38:58.797 INFO:teuthology.orchestra.run.smithi183.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.7 MB/s | 427 kB 00:00 2024-09-17T16:38:58.819 INFO:teuthology.orchestra.run.smithi060.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-17T16:38:58.827 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T16:38:58.835 INFO:teuthology.orchestra.run.smithi060.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-17T16:38:58.842 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T16:38:58.860 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T16:38:58.861 INFO:teuthology.orchestra.run.smithi060.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-17T16:38:58.864 INFO:teuthology.orchestra.run.smithi183.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 36 kB/s | 22 kB 00:00 2024-09-17T16:38:58.868 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:58.868 INFO:teuthology.orchestra.run.smithi183.stdout:Total 13 MB/s | 31 MB 00:02 2024-09-17T16:38:58.877 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T16:38:58.886 INFO:teuthology.orchestra.run.smithi060.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-17T16:38:58.893 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:38:58.893 INFO:teuthology.orchestra.run.smithi060.stdout:Total 9.5 MB/s | 31 MB 00:03 2024-09-17T16:38:58.901 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T16:38:58.923 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T16:38:58.936 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T16:38:58.963 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T16:38:58.971 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T16:38:59.014 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:38:59.019 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T16:38:59.051 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:38:59.052 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T16:38:59.055 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:38:59.055 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:38:59.064 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T16:38:59.096 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:38:59.096 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:38:59.131 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T16:38:59.204 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T16:38:59.269 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T16:38:59.289 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T16:38:59.359 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T16:38:59.364 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T16:38:59.388 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:38:59.420 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 10/12 2024-09-17T16:38:59.425 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T16:38:59.464 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T16:38:59.513 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T16:38:59.526 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:38:59.526 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:38:59.569 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T16:38:59.604 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:38:59.605 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:38:59.763 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T16:38:59.818 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T16:38:59.897 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T16:38:59.986 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T16:39:00.026 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T16:39:00.154 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T16:39:00.317 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 32/37 2024-09-17T16:39:00.345 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:39:00.371 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:39:00.371 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:00.371 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T16:39:00.371 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:39:00.372 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:39:00.372 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:00.900 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:00.967 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T16:39:01.006 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T16:39:01.044 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T16:39:01.110 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:01.115 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T16:39:01.169 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T16:39:01.172 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T16:39:01.206 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T16:39:01.210 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T16:39:01.233 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T16:39:01.309 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T16:39:01.310 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T16:39:01.389 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T16:39:01.437 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T16:39:01.466 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T16:39:01.472 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T16:39:01.499 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T16:39:01.502 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T16:39:01.537 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T16:39:01.570 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T16:39:01.595 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T16:39:01.610 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T16:39:01.654 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T16:39:01.673 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T16:39:01.689 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T16:39:01.727 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T16:39:01.737 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T16:39:01.761 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T16:39:01.769 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T16:39:01.791 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T16:39:01.825 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T16:39:01.829 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:39:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T16:39:01.857 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:39:01.857 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:01.857 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T16:39:01.857 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:39:01.857 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:39:01.858 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:01.858 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T16:39:01.900 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T16:39:01.943 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T16:39:01.976 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T16:39:02.006 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T16:39:02.026 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T16:39:02.066 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T16:39:02.095 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T16:39:02.142 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T16:39:02.148 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T16:39:02.187 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T16:39:02.237 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T16:39:02.294 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T16:39:02.300 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T16:39:02.322 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:39:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:39:02.346 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:02.346 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T16:39:02.346 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:39:02.346 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:39:02.346 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:02.386 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T16:39:02.489 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T16:39:02.534 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T16:39:02.553 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T16:39:02.573 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:39:02.591 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T16:39:02.594 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 11/12 2024-09-17T16:39:02.596 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:39:02.597 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:02.597 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T16:39:02.597 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:39:02.597 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:39:02.597 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:02.614 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T16:39:02.649 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T16:39:02.658 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:02.671 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:39:02.709 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T16:39:02.713 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T16:39:02.742 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T16:39:02.871 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T16:39:02.925 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T16:39:02.978 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T16:39:03.032 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 32/37 2024-09-17T16:39:03.059 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T16:39:03.069 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:39:03.095 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:39:03.096 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:03.096 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T16:39:03.096 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:39:03.096 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:39:03.096 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:03.156 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T16:39:03.202 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T16:39:03.339 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T16:39:03.515 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 32/37 2024-09-17T16:39:03.545 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:39:03.572 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 33/37 2024-09-17T16:39:03.572 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:03.572 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T16:39:03.572 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:39:03.572 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T16:39:03.572 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 1/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 3/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 4/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 5/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 6/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T16:39:04.547 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T16:39:04.548 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T16:39:04.549 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T16:39:04.549 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T16:39:04.549 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T16:39:04.549 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T16:39:04.550 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T16:39:04.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T16:39:04.570 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:39:04.598 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:39:04.598 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:04.598 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T16:39:04.598 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:39:04.598 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:39:04.598 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 1/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 2/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 3/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T16:39:04.614 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T16:39:04.615 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T16:39:04.615 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:04.615 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T16:39:04.615 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T16:39:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T16:39:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:04.928 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T16:39:04.928 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:04.929 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:05.054 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:39:05.078 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:39:05.078 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:05.078 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T16:39:05.078 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:39:05.078 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:39:05.078 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:05.121 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:39:05.150 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 34/37 2024-09-17T16:39:05.150 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:05.150 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T16:39:05.150 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:39:05.150 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T16:39:05.150 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:05.195 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T16:39:05.305 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:39:05.329 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:39:05.329 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:05.329 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T16:39:05.329 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:39:05.329 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:39:05.329 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:05.393 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:39:05.585 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T16:39:05.585 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:05.585 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:05.585 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T16:39:05.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T16:39:05.587 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T16:39:05.588 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:05.589 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:39:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 35/37 2024-09-17T16:39:05.655 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:05.655 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T16:39:05.656 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:39:05.656 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T16:39:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:05.770 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:08 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:05.889 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:39:05.902 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:05.903 INFO:teuthology.orchestra.run.smithi111.stdout:======================================================================================= 2024-09-17T16:39:05.903 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:39:05.903 INFO:teuthology.orchestra.run.smithi111.stdout:======================================================================================= 2024-09-17T16:39:05.903 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 7.4 M 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T16:39:05.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout:======================================================================================= 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout:Install 12 Packages 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:05.905 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 38 M 2024-09-17T16:39:05.906 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 212 M 2024-09-17T16:39:05.906 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 36/37 2024-09-17T16:39:05.914 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:05.914 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T16:39:05.914 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:39:05.915 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T16:39:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:05.981 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-base 2024-09-17T16:39:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:39:06.465 INFO:teuthology.orchestra.run.smithi111.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-17T16:39:06.532 INFO:teuthology.orchestra.run.smithi111.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-17T16:39:06.561 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:06.574 INFO:teuthology.orchestra.run.smithi111.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-17T16:39:06.641 INFO:teuthology.orchestra.run.smithi111.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-17T16:39:06.650 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:06.693 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:06.695 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:39:06.695 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:06.732 INFO:teuthology.orchestra.run.smithi111.stdout:(5/12): ceph-mgr-diskprediction-local-19.3.0-49 17 MB/s | 7.4 MB 00:00 2024-09-17T16:39:06.754 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install cephadm 2024-09-17T16:39:06.758 INFO:teuthology.orchestra.run.smithi111.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 329 kB/s | 38 kB 00:00 2024-09-17T16:39:06.833 INFO:teuthology.orchestra.run.smithi111.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-17T16:39:07.220 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:39:07.220 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 1/37 2024-09-17T16:39:07.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2/37 2024-09-17T16:39:07.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 3/37 2024-09-17T16:39:07.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 4/37 2024-09-17T16:39:07.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 5/37 2024-09-17T16:39:07.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 6/37 2024-09-17T16:39:07.221 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T16:39:07.222 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T16:39:07.223 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T16:39:07.224 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T16:39:07.224 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T16:39:07.224 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T16:39:07.224 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T16:39:07.224 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T16:39:07.224 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T16:39:07.233 INFO:teuthology.orchestra.run.smithi111.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.3 MB/s | 3.0 MB 00:00 2024-09-17T16:39:07.327 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:07.334 INFO:teuthology.orchestra.run.smithi111.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.5 MB/s | 250 kB 00:00 2024-09-17T16:39:07.456 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:07.457 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:07.457 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:07.457 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:07.457 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 784 k 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 784 k 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 791 k 2024-09-17T16:39:07.458 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:07.715 INFO:teuthology.orchestra.run.smithi098.stdout:cephadm-19.3.0-4975.g1889a165.el9.noarch.rpm 3.0 MB/s | 784 kB 00:00 2024-09-17T16:39:07.715 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:07.715 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.0 MB/s | 784 kB 00:00 2024-09-17T16:39:07.716 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:07.721 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:07.721 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:07.727 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:07.727 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:07.756 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 37/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.3.0-4975.g1889a165.el9.x86_64 1/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 3/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 4/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 5/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9. 6/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T16:39:07.757 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T16:39:07.758 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T16:39:07.759 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T16:39:07.812 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:07.984 INFO:teuthology.orchestra.run.smithi111.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.9 MB/s | 4.9 MB 00:01 2024-09-17T16:39:08.051 INFO:teuthology.orchestra.run.smithi111.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:08.116 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T16:39:08.117 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T16:39:08.118 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T16:39:08.119 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T16:39:08.120 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T16:39:08.120 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:08.120 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:08.243 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:08.336 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:08.537 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-base 2024-09-17T16:39:08.712 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:08.979 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:08.979 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:08.979 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:08.979 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:08.979 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:08.979 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:09.028 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T16:39:09.029 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T16:39:09.030 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T16:39:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T16:39:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T16:39:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T16:39:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T16:39:09.031 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:09.031 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:09.126 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:09.175 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T16:39:09.217 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:09.258 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:09.259 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:39:09.259 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:09.325 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install cephadm 2024-09-17T16:39:09.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-base 2024-09-17T16:39:09.761 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:09.893 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4975.g1889a165.el9 ceph 145 k 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:09.894 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:09.895 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:39:09.895 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:09.895 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 145 k 2024-09-17T16:39:09.895 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 432 k 2024-09-17T16:39:09.895 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:09.903 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:10.022 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:10.033 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:10.034 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:10.034 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:10.034 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:10.034 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 784 k 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 784 k 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 791 k 2024-09-17T16:39:10.035 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:10.114 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-immutable-object-cache-19.3.0-4975.g1889a1 663 kB/s | 145 kB 00:00 2024-09-17T16:39:10.114 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-base-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:Total 658 kB/s | 145 kB 00:00 2024-09-17T16:39:10.115 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:10.122 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:10.123 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:10.159 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:10.161 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:39:10.161 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:10.179 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:10.180 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:10.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install cephadm 2024-09-17T16:39:10.296 INFO:teuthology.orchestra.run.smithi183.stdout:cephadm-19.3.0-4975.g1889a165.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-17T16:39:10.296 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:10.297 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.9 MB/s | 784 kB 00:00 2024-09-17T16:39:10.297 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:10.302 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:10.302 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:10.308 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:10.308 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:10.330 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:10.386 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:10.398 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:10.423 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:10.423 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:10.424 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T16:39:10.424 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:10.792 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:10.833 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:56 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:10.908 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:10.970 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:10.970 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:10.970 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 784 k 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 784 k 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 791 k 2024-09-17T16:39:10.971 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:11.240 INFO:teuthology.orchestra.run.smithi060.stdout:cephadm-19.3.0-4975.g1889a165.el9.noarch.rpm 2.9 MB/s | 784 kB 00:00 2024-09-17T16:39:11.241 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:11.241 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.8 MB/s | 784 kB 00:00 2024-09-17T16:39:11.241 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:11.246 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:11.247 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:11.253 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:11.253 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:11.283 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:11.325 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:11.364 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:11.364 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:11.364 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:11.513 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:11.513 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:11.513 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:11.513 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:11.513 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:11.513 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:11.574 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr 2024-09-17T16:39:11.584 INFO:teuthology.orchestra.run.smithi111.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-17T16:39:11.585 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:11.585 INFO:teuthology.orchestra.run.smithi111.stdout:Total 6.7 MB/s | 38 MB 00:05 2024-09-17T16:39:11.713 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T16:39:11.854 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:11.938 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:11.944 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:11.969 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:11.970 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:12.163 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:12.253 INFO:teuthology.orchestra.run.smithi098.stdout:Package ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:12.295 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:12.295 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:12.296 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:39:12.296 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:12.324 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:12.362 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T16:39:12.403 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:12.404 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:12.427 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4975.g1889a165.el9 ceph 145 k 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:12.428 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:39:12.429 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:12.429 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 145 k 2024-09-17T16:39:12.429 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 432 k 2024-09-17T16:39:12.429 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:12.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:12.588 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:12.588 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:12.588 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:12.588 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:12.588 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:12.634 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-immutable-object-cache-19.3.0-4975.g1889a1 707 kB/s | 145 kB 00:00 2024-09-17T16:39:12.635 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:12.635 INFO:teuthology.orchestra.run.smithi183.stdout:Total 701 kB/s | 145 kB 00:00 2024-09-17T16:39:12.635 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:12.643 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:12.643 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:12.700 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:12.700 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:12.785 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T16:39:12.853 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:12.935 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:12.940 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:12.960 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:12.960 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:12.960 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T16:39:12.960 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:13.072 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:13.073 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:13.073 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:13.073 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:13.073 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 14 M 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 34 k 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 16 k 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T16:39:13.074 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-17T16:39:13.075 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:13.076 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 19 M 2024-09-17T16:39:13.076 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 159 M 2024-09-17T16:39:13.076 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:13.165 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:13.234 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T16:39:13.274 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:13.374 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:13.391 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:13.425 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T16:39:13.530 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4975.g1889a165.el9 ceph 145 k 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:13.531 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 145 k 2024-09-17T16:39:13.532 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 432 k 2024-09-17T16:39:13.532 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:13.612 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T16:39:13.640 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T16:39:13.721 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-immutable-object-cache-19.3.0-4975.g1889a1 767 kB/s | 145 kB 00:00 2024-09-17T16:39:13.721 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:13.722 INFO:teuthology.orchestra.run.smithi060.stdout:Total 761 kB/s | 145 kB 00:00 2024-09-17T16:39:13.722 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:13.729 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:13.730 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:13.731 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T16:39:13.791 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:13.791 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:13.877 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4975.g18 243 kB/s | 34 kB 00:00 2024-09-17T16:39:13.893 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4975.g188 105 kB/s | 16 kB 00:00 2024-09-17T16:39:13.925 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:13.925 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:13.925 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:13.925 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:13.925 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:13.925 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:13.938 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:13.996 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:14.023 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:14.023 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:14.023 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T16:39:14.023 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:14.035 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-17T16:39:14.069 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-17T16:39:14.119 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-17T16:39:14.145 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-17T16:39:14.162 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr 2024-09-17T16:39:14.211 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-17T16:39:14.237 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-17T16:39:14.262 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-17T16:39:14.287 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 3.3 MB/s | 863 kB 00:00 2024-09-17T16:39:14.312 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T16:39:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T16:39:14.488 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): ceph-mgr-dashboard-19.3.0-4975.g1889a1 19 MB/s | 14 MB 00:00 2024-09-17T16:39:14.491 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:14.492 INFO:teuthology.orchestra.run.smithi098.stdout:Total 14 MB/s | 19 MB 00:01 2024-09-17T16:39:14.504 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T16:39:14.544 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:14.563 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:14.563 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:14.757 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:59 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:14.834 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:14.846 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:14.889 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:14.889 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:39:14.890 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:14.959 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T16:39:14.970 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4975.g1889a165. 1/1 2024-09-17T16:39:14.970 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:14.970 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:14.970 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:14.970 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:14.970 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:15.345 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr 2024-09-17T16:39:15.432 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:15.505 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T16:39:15.537 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:15.540 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T16:39:15.587 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T16:39:15.626 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T16:39:15.672 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 14 M 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 34 k 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 16 k 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T16:39:15.674 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout:Install 12 Packages 2024-09-17T16:39:15.675 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:15.676 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 19 M 2024-09-17T16:39:15.676 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 159 M 2024-09-17T16:39:15.676 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:15.728 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T16:39:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:15.861 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T16:39:15.959 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T16:39:15.962 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:16.014 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T16:39:16.043 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:16.055 INFO:teuthology.orchestra.run.smithi060.stdout:Package ceph-mgr-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:16.075 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 10/12 2024-09-17T16:39:16.100 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:16.101 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:39:16.101 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:16.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T16:39:16.480 INFO:teuthology.orchestra.run.smithi183.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4975.g18 244 kB/s | 34 kB 00:00 2024-09-17T16:39:16.506 INFO:teuthology.orchestra.run.smithi183.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4975.g188 99 kB/s | 16 kB 00:00 2024-09-17T16:39:16.656 INFO:teuthology.orchestra.run.smithi183.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-09-17T16:39:16.706 INFO:teuthology.orchestra.run.smithi183.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-17T16:39:16.765 INFO:teuthology.orchestra.run.smithi183.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T16:39:16.769 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:02 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:16.790 INFO:teuthology.orchestra.run.smithi183.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-17T16:39:16.811 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T16:39:16.840 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:16.866 INFO:teuthology.orchestra.run.smithi183.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-17T16:39:16.892 INFO:teuthology.orchestra.run.smithi183.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-17T16:39:16.907 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 14 M 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:39:16.909 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T16:39:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 34 k 2024-09-17T16:39:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 16 k 2024-09-17T16:39:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T16:39:16.910 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout:Install 12 Packages 2024-09-17T16:39:16.911 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:16.912 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 19 M 2024-09-17T16:39:16.912 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 159 M 2024-09-17T16:39:16.912 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:16.916 INFO:teuthology.orchestra.run.smithi183.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-17T16:39:16.950 INFO:teuthology.orchestra.run.smithi183.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.6 MB/s | 188 kB 00:00 2024-09-17T16:39:17.117 INFO:teuthology.orchestra.run.smithi183.stdout:(11/12): ceph-mgr-dashboard-19.3.0-4975.g1889a1 18 MB/s | 14 MB 00:00 2024-09-17T16:39:17.158 INFO:teuthology.orchestra.run.smithi183.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.7 MB/s | 863 kB 00:00 2024-09-17T16:39:17.162 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:17.162 INFO:teuthology.orchestra.run.smithi183.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-17T16:39:17.213 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:17.231 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:17.232 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:17.505 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:17.505 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:17.715 INFO:teuthology.orchestra.run.smithi060.stdout:(1/12): ceph-grafana-dashboards-19.3.0-4975.g18 234 kB/s | 34 kB 00:00 2024-09-17T16:39:17.740 INFO:teuthology.orchestra.run.smithi060.stdout:(2/12): ceph-prometheus-alerts-19.3.0-4975.g188 96 kB/s | 16 kB 00:00 2024-09-17T16:39:18.115 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:18.200 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T16:39:18.232 INFO:teuthology.orchestra.run.smithi060.stdout:(3/12): ceph-mgr-dashboard-19.3.0-4975.g1889a16 21 MB/s | 14 MB 00:00 2024-09-17T16:39:18.244 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T16:39:18.290 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T16:39:18.324 INFO:teuthology.orchestra.run.smithi060.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 462 kB/s | 269 kB 00:00 2024-09-17T16:39:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T16:39:18.374 INFO:teuthology.orchestra.run.smithi060.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-17T16:39:18.399 INFO:teuthology.orchestra.run.smithi060.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-17T16:39:18.439 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T16:39:18.467 INFO:teuthology.orchestra.run.smithi060.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 30 MB/s | 2.0 MB 00:00 2024-09-17T16:39:18.492 INFO:teuthology.orchestra.run.smithi060.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-17T16:39:18.517 INFO:teuthology.orchestra.run.smithi060.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-17T16:39:18.543 INFO:teuthology.orchestra.run.smithi060.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-17T16:39:18.562 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T16:39:18.576 INFO:teuthology.orchestra.run.smithi060.stdout:(11/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-17T16:39:18.656 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T16:39:18.718 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T16:39:18.746 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:18.779 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 10/12 2024-09-17T16:39:19.060 INFO:teuthology.orchestra.run.smithi060.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-17T16:39:19.063 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:19.063 INFO:teuthology.orchestra.run.smithi060.stdout:Total 9.0 MB/s | 19 MB 00:02 2024-09-17T16:39:19.117 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:19.138 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:19.138 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:19.259 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 11/12 2024-09-17T16:39:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:19.425 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:19.426 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 1/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T16:39:19.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T16:39:19.466 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T16:39:19.466 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:19.466 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T16:39:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T16:39:19.903 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:19.903 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:19.904 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T16:39:19.905 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:19.905 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:20.253 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T16:39:20.288 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T16:39:20.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-rook 2024-09-17T16:39:20.336 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T16:39:20.364 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T16:39:20.475 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T16:39:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T16:39:20.696 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T16:39:20.745 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T16:39:20.772 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:20.797 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 10/12 2024-09-17T16:39:20.915 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:21.056 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:21.057 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:21.057 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:39:21.057 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:21.057 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:21.057 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 49 k 2024-09-17T16:39:21.057 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T16:39:21.058 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:21.059 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:21.059 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:21.059 INFO:teuthology.orchestra.run.smithi111.stdout:Install 13 Packages 2024-09-17T16:39:21.059 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:21.059 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.2 M 2024-09-17T16:39:21.059 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 26 M 2024-09-17T16:39:21.060 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 1/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 2/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 3/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T16:39:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T16:39:21.523 INFO:teuthology.orchestra.run.smithi111.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 186 kB/s | 19 kB 00:00 2024-09-17T16:39:21.548 INFO:teuthology.orchestra.run.smithi111.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 200 kB/s | 26 kB 00:00 2024-09-17T16:39:21.582 INFO:teuthology.orchestra.run.smithi111.stdout:(3/13): ceph-mgr-rook-19.3.0-4975.g1889a165.el9 305 kB/s | 49 kB 00:00 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:21.585 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:21.586 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:21.657 INFO:teuthology.orchestra.run.smithi111.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-17T16:39:21.682 INFO:teuthology.orchestra.run.smithi111.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-17T16:39:21.707 INFO:teuthology.orchestra.run.smithi111.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T16:39:21.749 INFO:teuthology.orchestra.run.smithi111.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-17T16:39:21.774 INFO:teuthology.orchestra.run.smithi111.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-17T16:39:21.800 INFO:teuthology.orchestra.run.smithi111.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-09-17T16:39:21.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T16:39:21.833 INFO:teuthology.orchestra.run.smithi111.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2024-09-17T16:39:21.859 INFO:teuthology.orchestra.run.smithi111.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-17T16:39:21.884 INFO:teuthology.orchestra.run.smithi111.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-17T16:39:21.926 INFO:teuthology.orchestra.run.smithi111.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-17T16:39:21.929 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:21.929 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-17T16:39:21.962 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 11/12 2024-09-17T16:39:21.992 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:22.007 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:22.007 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:22.025 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:22.098 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:22.098 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:22.415 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:09 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:22.556 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-17T16:39:22.557 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-17T16:39:22.557 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 7.4 M 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T16:39:22.558 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T16:39:22.559 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T16:39:22.559 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:22.559 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:22.559 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-17T16:39:22.559 INFO:teuthology.orchestra.run.smithi098.stdout:Install 12 Packages 2024-09-17T16:39:22.559 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:22.560 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 38 M 2024-09-17T16:39:22.560 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 212 M 2024-09-17T16:39:22.560 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:22.613 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:22.805 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T16:39:22.860 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T16:39:22.905 INFO:teuthology.orchestra.run.smithi098.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-17T16:39:22.924 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T16:39:22.961 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T16:39:22.972 INFO:teuthology.orchestra.run.smithi098.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-17T16:39:23.003 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T16:39:23.005 INFO:teuthology.orchestra.run.smithi098.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-17T16:39:23.048 INFO:teuthology.orchestra.run.smithi098.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 438 kB/s | 18 kB 00:00 2024-09-17T16:39:23.089 INFO:teuthology.orchestra.run.smithi098.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 924 kB/s | 38 kB 00:00 2024-09-17T16:39:23.105 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T16:39:23.214 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T16:39:23.239 INFO:teuthology.orchestra.run.smithi098.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-49 16 MB/s | 7.4 MB 00:00 2024-09-17T16:39:23.271 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T16:39:23.457 INFO:teuthology.orchestra.run.smithi098.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-17T16:39:23.890 INFO:teuthology.orchestra.run.smithi098.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2024-09-17T16:39:23.977 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 1/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 2/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 3/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T16:39:24.028 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:24.029 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T16:39:24.029 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T16:39:24.032 INFO:teuthology.orchestra.run.smithi098.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-17T16:39:24.035 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T16:39:24.069 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T16:39:24.117 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T16:39:24.156 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 11/12 2024-09-17T16:39:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:24.349 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T16:39:24.349 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:24.349 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T16:39:24.350 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T16:39:24.351 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T16:39:24.351 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T16:39:24.351 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:24.351 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:24.605 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T16:39:24.841 INFO:teuthology.orchestra.run.smithi098.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.8 MB/s | 4.9 MB 00:01 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 1/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T16:39:24.985 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T16:39:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T16:39:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T16:39:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T16:39:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T16:39:24.986 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T16:39:25.183 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:10 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:25.316 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 7.4 M 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T16:39:25.317 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-09-17T16:39:25.318 INFO:teuthology.orchestra.run.smithi183.stdout:Install 12 Packages 2024-09-17T16:39:25.319 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:25.319 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 38 M 2024-09-17T16:39:25.319 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 212 M 2024-09-17T16:39:25.319 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:25.323 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T16:39:25.324 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T16:39:25.325 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T16:39:25.325 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T16:39:25.325 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T16:39:25.325 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:25.325 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:25.349 INFO:teuthology.orchestra.run.smithi098.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.7 MB/s | 5.1 MB 00:01 2024-09-17T16:39:25.573 INFO:teuthology.orchestra.run.smithi183.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-17T16:39:25.587 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T16:39:25.673 INFO:teuthology.orchestra.run.smithi183.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-17T16:39:25.699 INFO:teuthology.orchestra.run.smithi183.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-17T16:39:25.832 INFO:teuthology.orchestra.run.smithi183.stdout:(4/12): ceph-mgr-diskprediction-local-19.3.0-49 17 MB/s | 7.4 MB 00:00 2024-09-17T16:39:25.858 INFO:teuthology.orchestra.run.smithi183.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 115 kB/s | 18 kB 00:00 2024-09-17T16:39:25.941 INFO:teuthology.orchestra.run.smithi183.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-17T16:39:26.058 INFO:teuthology.orchestra.run.smithi183.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 12/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el 1/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noa 2/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9 3/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T16:39:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T16:39:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T16:39:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T16:39:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T16:39:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T16:39:26.161 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:26.294 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 154 k 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T16:39:26.295 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:26.296 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 7.0 M 2024-09-17T16:39:26.297 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 33 M 2024-09-17T16:39:26.297 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:26.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:26.488 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:26.675 INFO:teuthology.orchestra.run.smithi183.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.0 MB/s | 3.0 MB 00:01 2024-09-17T16:39:26.720 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4975.g1889a165.e 707 kB/s | 154 kB 00:00 2024-09-17T16:39:26.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T16:39:26.779 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 10 MB/s | 548 kB 00:00 2024-09-17T16:39:26.792 INFO:teuthology.orchestra.run.smithi183.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-17T16:39:26.804 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-17T16:39:26.830 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 3.0 MB/s | 74 kB 00:00 2024-09-17T16:39:27.159 INFO:teuthology.orchestra.run.smithi183.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.8 MB/s | 4.9 MB 00:01 2024-09-17T16:39:27.234 INFO:teuthology.orchestra.run.smithi183.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.3 MB/s | 5.1 MB 00:01 2024-09-17T16:39:27.263 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 326 kB/s | 248 kB 00:00 2024-09-17T16:39:27.352 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:13 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:27.488 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 7.4 M 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:39:27.489 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:27.490 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:27.491 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-17T16:39:27.491 INFO:teuthology.orchestra.run.smithi060.stdout:Install 12 Packages 2024-09-17T16:39:27.491 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:27.491 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 38 M 2024-09-17T16:39:27.491 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 212 M 2024-09-17T16:39:27.491 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:27.667 INFO:teuthology.orchestra.run.smithi060.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-17T16:39:27.717 INFO:teuthology.orchestra.run.smithi060.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-17T16:39:27.755 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-17T16:39:27.757 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:27.757 INFO:teuthology.orchestra.run.smithi111.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-17T16:39:27.801 INFO:teuthology.orchestra.run.smithi060.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-17T16:39:27.830 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:27.842 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:27.842 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:27.851 INFO:teuthology.orchestra.run.smithi060.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-17T16:39:27.918 INFO:teuthology.orchestra.run.smithi060.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 578 kB/s | 38 kB 00:00 2024-09-17T16:39:27.941 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:27.942 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:28.035 INFO:teuthology.orchestra.run.smithi060.stdout:(6/12): ceph-mgr-diskprediction-local-19.3.0-49 15 MB/s | 7.4 MB 00:00 2024-09-17T16:39:28.093 INFO:teuthology.orchestra.run.smithi060.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.9 MB/s | 3.0 MB 00:00 2024-09-17T16:39:28.235 INFO:teuthology.orchestra.run.smithi060.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-17T16:39:28.249 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:28.319 INFO:teuthology.orchestra.run.smithi060.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2024-09-17T16:39:28.344 INFO:teuthology.orchestra.run.smithi060.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-09-17T16:39:28.369 INFO:teuthology.orchestra.run.smithi060.stdout:(11/12): python3-devel-3.9.19-8.el9.x86_64.rpm 732 kB/s | 245 kB 00:00 2024-09-17T16:39:28.411 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T16:39:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T16:39:28.645 INFO:teuthology.orchestra.run.smithi060.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-09-17T16:39:28.646 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:28.646 INFO:teuthology.orchestra.run.smithi060.stdout:Total 33 MB/s | 38 MB 00:01 2024-09-17T16:39:28.982 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T16:39:29.007 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:29.035 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:29.035 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:29.075 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T16:39:29.144 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T16:39:29.168 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:29.491 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:29.492 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:29.675 INFO:teuthology.orchestra.run.smithi183.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-17T16:39:29.677 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:29.677 INFO:teuthology.orchestra.run.smithi183.stdout:Total 8.8 MB/s | 38 MB 00:04 2024-09-17T16:39:29.950 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:29.950 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/6 2024-09-17T16:39:29.950 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T16:39:29.950 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T16:39:29.950 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T16:39:29.950 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T16:39:30.040 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:30.066 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:30.066 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:30.215 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:30.216 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:30.378 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T16:39:30.419 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:30.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-fuse 2024-09-17T16:39:30.492 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:30.493 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:30.523 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:30.561 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T16:39:30.753 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T16:39:30.785 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T16:39:30.864 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T16:39:31.054 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:31.158 INFO:teuthology.orchestra.run.smithi098.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:07 2024-09-17T16:39:31.159 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:31.159 INFO:teuthology.orchestra.run.smithi098.stdout:Total 4.4 MB/s | 38 MB 00:08 2024-09-17T16:39:31.185 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:31.185 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:31.185 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 899 k 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2024-09-17T16:39:31.186 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:31.187 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 979 k 2024-09-17T16:39:31.187 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 2.9 M 2024-09-17T16:39:31.187 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:31.264 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:31.331 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T16:39:31.356 INFO:teuthology.orchestra.run.smithi111.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 649 kB/s | 80 kB 00:00 2024-09-17T16:39:31.373 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:31.506 INFO:teuthology.orchestra.run.smithi111.stdout:(2/2): ceph-fuse-19.3.0-4975.g1889a165.el9.x86_ 3.2 MB/s | 899 kB 00:00 2024-09-17T16:39:31.507 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:31.507 INFO:teuthology.orchestra.run.smithi111.stdout:Total 3.0 MB/s | 979 kB 00:00 2024-09-17T16:39:31.517 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T16:39:31.518 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:31.518 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:31.540 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:31.540 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:31.545 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:31.545 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:31.555 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T16:39:31.623 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:31.624 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:31.676 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T16:39:31.703 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T16:39:31.741 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T16:39:31.811 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:31.826 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T16:39:31.946 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T16:39:31.982 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:31.982 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:32.014 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:32.476 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T16:39:32.596 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T16:39:32.739 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:32.739 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/2 2024-09-17T16:39:32.741 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:32.806 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T16:39:32.847 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:32.999 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T16:39:33.003 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:33.010 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T16:39:33.010 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:33.011 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:33.011 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T16:39:33.011 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:33.011 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:33.185 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T16:39:33.214 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T16:39:33.290 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T16:39:33.302 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-volume 2024-09-17T16:39:33.849 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:33.899 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:33.957 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T16:39:34.037 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:34.038 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-17T16:39:34.038 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:34.038 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 285 k 2024-09-17T16:39:34.038 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 285 k 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 1.3 M 2024-09-17T16:39:34.039 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:34.078 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T16:39:34.081 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T16:39:34.109 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:34.245 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-volume-19.3.0-4975.g1889a165.el9.noarch.rp 1.4 MB/s | 285 kB 00:00 2024-09-17T16:39:34.245 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:34.246 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-17T16:39:34.246 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:34.254 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:34.254 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:34.286 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:34.286 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:34.502 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:34.580 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:34.597 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:34.597 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:34.597 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T16:39:34.597 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:34.890 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T16:39:34.923 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:35.347 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:35.640 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:35.640 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:35.640 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:35.640 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:35.640 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:35.640 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:35.985 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados-devel 2024-09-17T16:39:36.415 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T16:39:36.448 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:36.583 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:36.717 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:36.718 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-17T16:39:36.718 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:36.718 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:36.718 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 126 k 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 126 k 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 456 k 2024-09-17T16:39:36.719 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:36.771 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:36.771 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 1/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:36.772 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T16:39:36.900 INFO:teuthology.orchestra.run.smithi111.stdout:librados-devel-19.3.0-4975.g1889a165.el9.x86_64 698 kB/s | 126 kB 00:00 2024-09-17T16:39:36.901 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:36.901 INFO:teuthology.orchestra.run.smithi111.stdout:Total 693 kB/s | 126 kB 00:00 2024-09-17T16:39:36.901 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:36.906 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:36.971 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:36.971 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:37.137 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T16:39:37.211 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:37.212 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:37.274 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:37.555 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 1/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:37.556 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T16:39:37.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-rook 2024-09-17T16:39:37.708 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T16:39:37.933 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:37.934 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:37.972 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:37.972 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:37.972 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:37.972 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:38.184 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:38.210 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs2 2024-09-17T16:39:38.317 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-rook 2024-09-17T16:39:38.323 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 49 k 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:39:38.324 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T16:39:38.325 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout:Install 13 Packages 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 2.2 M 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 26 M 2024-09-17T16:39:38.326 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:38.806 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:38.897 INFO:teuthology.orchestra.run.smithi111.stdout:Package libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:38.918 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:38.941 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:38.943 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:38.943 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:39.005 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs-devel 2024-09-17T16:39:39.045 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 12/12 2024-09-17T16:39:39.045 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a 1/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T16:39:39.046 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T16:39:39.053 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 49 k 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:39:39.054 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T16:39:39.055 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T16:39:39.056 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:39.056 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:39.056 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:39.056 INFO:teuthology.orchestra.run.smithi183.stdout:Install 13 Packages 2024-09-17T16:39:39.056 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:39.057 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 2.2 M 2024-09-17T16:39:39.057 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 26 M 2024-09-17T16:39:39.057 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:39.134 INFO:teuthology.orchestra.run.smithi060.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 173 kB/s | 19 kB 00:00 2024-09-17T16:39:39.159 INFO:teuthology.orchestra.run.smithi060.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 188 kB/s | 26 kB 00:00 2024-09-17T16:39:39.184 INFO:teuthology.orchestra.run.smithi060.stdout:(3/13): ceph-mgr-rook-19.3.0-4975.g1889a165.el9 305 kB/s | 49 kB 00:00 2024-09-17T16:39:39.268 INFO:teuthology.orchestra.run.smithi060.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-17T16:39:39.293 INFO:teuthology.orchestra.run.smithi060.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-17T16:39:39.308 INFO:teuthology.orchestra.run.smithi183.stdout:(1/13): ceph-mgr-rook-19.3.0-4975.g1889a165.el9 304 kB/s | 49 kB 00:00 2024-09-17T16:39:39.319 INFO:teuthology.orchestra.run.smithi060.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T16:39:39.333 INFO:teuthology.orchestra.run.smithi183.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 137 kB/s | 26 kB 00:00 2024-09-17T16:39:39.358 INFO:teuthology.orchestra.run.smithi183.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 90 kB/s | 19 kB 00:00 2024-09-17T16:39:39.369 INFO:teuthology.orchestra.run.smithi060.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-17T16:39:39.394 INFO:teuthology.orchestra.run.smithi060.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-17T16:39:39.428 INFO:teuthology.orchestra.run.smithi060.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 130 kB/s | 14 kB 00:00 2024-09-17T16:39:39.462 INFO:teuthology.orchestra.run.smithi060.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.9 MB/s | 59 kB 00:00 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T16:39:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:39.473 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:39.495 INFO:teuthology.orchestra.run.smithi060.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-09-17T16:39:39.537 INFO:teuthology.orchestra.run.smithi060.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 7.6 MB/s | 1.0 MB 00:00 2024-09-17T16:39:39.550 INFO:teuthology.orchestra.run.smithi183.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 918 kB/s | 222 kB 00:00 2024-09-17T16:39:39.562 INFO:teuthology.orchestra.run.smithi060.stdout:(13/13): python3-google-auth-2.34.0-1.el9.noarc 1.1 MB/s | 220 kB 00:00 2024-09-17T16:39:39.565 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:39.566 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-09-17T16:39:39.575 INFO:teuthology.orchestra.run.smithi183.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 731 kB/s | 159 kB 00:00 2024-09-17T16:39:39.586 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:39.609 INFO:teuthology.orchestra.run.smithi183.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 910 kB/s | 54 kB 00:00 2024-09-17T16:39:39.637 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:39.643 INFO:teuthology.orchestra.run.smithi183.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-17T16:39:39.654 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:39.654 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:39.668 INFO:teuthology.orchestra.run.smithi183.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 901 kB/s | 279 kB 00:00 2024-09-17T16:39:39.685 INFO:teuthology.orchestra.run.smithi183.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 191 kB/s | 14 kB 00:00 2024-09-17T16:39:39.721 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:39.721 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:39.721 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-17T16:39:39.721 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 32 k 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:39:39.722 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:39.723 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 32 k 2024-09-17T16:39:39.723 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 142 k 2024-09-17T16:39:39.723 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:39.727 INFO:teuthology.orchestra.run.smithi183.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-17T16:39:39.744 INFO:teuthology.orchestra.run.smithi183.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-17T16:39:39.751 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:39.752 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:39.769 INFO:teuthology.orchestra.run.smithi183.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.2 MB/s | 90 kB 00:00 2024-09-17T16:39:39.869 INFO:teuthology.orchestra.run.smithi183.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-09-17T16:39:39.870 INFO:teuthology.orchestra.run.smithi111.stdout:libcephfs-devel-19.3.0-4975.g1889a165.el9.x86_6 216 kB/s | 32 kB 00:00 2024-09-17T16:39:39.870 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:39.871 INFO:teuthology.orchestra.run.smithi111.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-17T16:39:39.871 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:39.872 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:39.872 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.7 MB/s | 2.2 MB 00:00 2024-09-17T16:39:39.875 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:39.875 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:39.883 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-rook 2024-09-17T16:39:39.897 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:39.897 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:39.937 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:39.952 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:39.953 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:39.991 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:40.041 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:40.041 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:40.110 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:40.272 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:40.461 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T16:39:40.472 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:27 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:40.505 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:40.523 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T16:39:40.553 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:40.580 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T16:39:40.606 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 49 k 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T16:39:40.608 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:40.609 INFO:teuthology.orchestra.run.smithi098.stdout:Install 13 Packages 2024-09-17T16:39:40.610 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:40.610 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 2.2 M 2024-09-17T16:39:40.610 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 26 M 2024-09-17T16:39:40.610 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:40.615 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T16:39:40.657 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T16:39:40.726 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T16:39:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:40.739 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:40.739 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:40.739 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:40.764 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T16:39:40.787 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T16:39:40.859 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T16:39:40.873 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T16:39:40.896 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T16:39:40.910 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2024-09-17T16:39:40.926 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T16:39:40.937 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T16:39:41.048 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T16:39:41.140 INFO:teuthology.orchestra.run.smithi098.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 215 kB/s | 19 kB 00:00 2024-09-17T16:39:41.149 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T16:39:41.165 INFO:teuthology.orchestra.run.smithi098.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 224 kB/s | 26 kB 00:00 2024-09-17T16:39:41.207 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T16:39:41.224 INFO:teuthology.orchestra.run.smithi098.stdout:(3/13): ceph-mgr-rook-19.3.0-4975.g1889a165.el9 284 kB/s | 49 kB 00:00 2024-09-17T16:39:41.249 INFO:teuthology.orchestra.run.smithi098.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-17T16:39:41.275 INFO:teuthology.orchestra.run.smithi098.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-17T16:39:41.300 INFO:teuthology.orchestra.run.smithi098.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T16:39:41.342 INFO:teuthology.orchestra.run.smithi098.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-17T16:39:41.367 INFO:teuthology.orchestra.run.smithi098.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-17T16:39:41.393 INFO:teuthology.orchestra.run.smithi098.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.6 MB/s | 279 kB 00:00 2024-09-17T16:39:41.426 INFO:teuthology.orchestra.run.smithi098.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-17T16:39:41.451 INFO:teuthology.orchestra.run.smithi098.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-17T16:39:41.468 INFO:teuthology.orchestra.run.smithi098.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-09-17T16:39:41.492 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:41.510 INFO:teuthology.orchestra.run.smithi098.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-17T16:39:41.513 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:41.513 INFO:teuthology.orchestra.run.smithi098.stdout:Total 2.4 MB/s | 2.2 MB 00:00 2024-09-17T16:39:41.580 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:41.580 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:41.595 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:41.595 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:41.624 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:41.625 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:41.625 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:41.683 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:41.684 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:41.689 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librbd1 2024-09-17T16:39:41.689 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T16:39:41.738 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T16:39:41.772 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T16:39:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T16:39:41.850 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:41.928 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T16:39:41.979 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T16:39:42.012 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T16:39:42.061 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T16:39:42.082 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:42.206 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:42.266 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:42.356 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:42.376 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T16:39:42.399 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:42.400 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:42.400 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:42.428 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T16:39:42.471 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rados 2024-09-17T16:39:42.492 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T16:39:42.529 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T16:39:42.572 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 1/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T16:39:42.668 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T16:39:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T16:39:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T16:39:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T16:39:42.669 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T16:39:42.764 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T16:39:42.804 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:42.804 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 1/13 2024-09-17T16:39:42.804 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T16:39:42.804 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T16:39:42.804 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T16:39:42.804 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T16:39:42.805 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T16:39:42.874 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T16:39:42.930 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T16:39:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T16:39:43.009 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T16:39:43.010 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T16:39:43.011 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:43.011 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:43.041 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:43.130 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T16:39:43.137 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:43.138 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:43.174 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:43.175 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:43.175 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:43.237 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rgw 2024-09-17T16:39:43.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T16:39:43.427 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T16:39:43.649 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T16:39:43.703 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T16:39:43.737 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T16:39:43.785 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T16:39:43.806 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:43.809 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:43.846 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:29 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:43.898 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:43.940 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:43.941 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:43.942 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:43.986 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:43.987 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:43.987 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:43.987 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 154 k 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:43.988 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:43.989 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:43.989 INFO:teuthology.orchestra.run.smithi060.stdout:Install 6 Packages 2024-09-17T16:39:43.989 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:43.989 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 7.0 M 2024-09-17T16:39:43.989 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 33 M 2024-09-17T16:39:43.990 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:43.999 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:28 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:44.012 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-cephfs 2024-09-17T16:39:44.132 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:44.132 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 154 k 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T16:39:44.133 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T16:39:44.134 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:44.134 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:44.134 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:44.134 INFO:teuthology.orchestra.run.smithi183.stdout:Install 6 Packages 2024-09-17T16:39:44.134 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:44.135 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 7.0 M 2024-09-17T16:39:44.135 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 33 M 2024-09-17T16:39:44.135 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:44.231 INFO:teuthology.orchestra.run.smithi060.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-17T16:39:44.281 INFO:teuthology.orchestra.run.smithi060.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-17T16:39:44.307 INFO:teuthology.orchestra.run.smithi060.stdout:(3/6): ceph-mgr-cephadm-19.3.0-4975.g1889a165.e 726 kB/s | 154 kB 00:00 2024-09-17T16:39:44.332 INFO:teuthology.orchestra.run.smithi060.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T16:39:44.374 INFO:teuthology.orchestra.run.smithi060.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-17T16:39:44.449 INFO:teuthology.orchestra.run.smithi060.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-17T16:39:44.451 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:44.452 INFO:teuthology.orchestra.run.smithi060.stdout:Total 15 MB/s | 7.0 MB 00:00 2024-09-17T16:39:44.524 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:44.536 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:44.537 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:44.542 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 13/13 2024-09-17T16:39:44.542 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 1/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T16:39:44.543 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T16:39:44.580 INFO:teuthology.orchestra.run.smithi183.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4975.g1889a165.e 691 kB/s | 154 kB 00:00 2024-09-17T16:39:44.594 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:44.638 INFO:teuthology.orchestra.run.smithi183.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 12 MB/s | 548 kB 00:00 2024-09-17T16:39:44.642 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:44.643 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:44.663 INFO:teuthology.orchestra.run.smithi183.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T16:39:44.684 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:44.688 INFO:teuthology.orchestra.run.smithi183.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-17T16:39:44.727 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:44.728 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:44.728 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:44.788 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rbd 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T16:39:44.881 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:44.882 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:45.097 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:45.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T16:39:45.130 INFO:teuthology.orchestra.run.smithi183.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 320 kB/s | 248 kB 00:00 2024-09-17T16:39:45.293 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T16:39:45.351 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T16:39:45.366 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:45.455 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:45.500 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-17T16:39:45.501 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:45.561 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-fuse 2024-09-17T16:39:45.597 INFO:teuthology.orchestra.run.smithi183.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.8 MB/s | 6.0 MB 00:01 2024-09-17T16:39:45.600 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:45.600 INFO:teuthology.orchestra.run.smithi183.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-17T16:39:45.676 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:45.692 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:45.692 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:45.707 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:32 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:45.794 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:45.794 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:45.840 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 154 k 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:45.841 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:45.842 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:45.842 INFO:teuthology.orchestra.run.smithi098.stdout:Install 6 Packages 2024-09-17T16:39:45.842 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:45.842 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 7.0 M 2024-09-17T16:39:45.842 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 33 M 2024-09-17T16:39:45.842 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T16:39:45.999 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T16:39:46.074 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T16:39:46.105 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:46.107 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:46.132 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:46.146 INFO:teuthology.orchestra.run.smithi098.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-17T16:39:46.205 INFO:teuthology.orchestra.run.smithi098.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-17T16:39:46.230 INFO:teuthology.orchestra.run.smithi098.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T16:39:46.264 INFO:teuthology.orchestra.run.smithi098.stdout:(4/6): ceph-mgr-cephadm-19.3.0-4975.g1889a165.e 622 kB/s | 154 kB 00:00 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 85 k 2024-09-17T16:39:46.265 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 85 k 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 231 k 2024-09-17T16:39:46.266 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:46.274 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T16:39:46.289 INFO:teuthology.orchestra.run.smithi098.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-17T16:39:46.332 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T16:39:46.381 INFO:teuthology.orchestra.run.smithi098.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-17T16:39:46.383 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:46.383 INFO:teuthology.orchestra.run.smithi098.stdout:Total 13 MB/s | 7.0 MB 00:00 2024-09-17T16:39:46.454 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:46.456 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-fuse-19.3.0-4975.g1889a165.el9.x86_64.rpm 447 kB/s | 85 kB 00:00 2024-09-17T16:39:46.457 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:46.457 INFO:teuthology.orchestra.run.smithi111.stdout:Total 444 kB/s | 85 kB 00:00 2024-09-17T16:39:46.457 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:46.464 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:46.464 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:46.465 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:46.465 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:46.528 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:46.528 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:46.564 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:46.566 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:46.678 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:46.779 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:46.865 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T16:39:46.867 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:46.961 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T16:39:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/6 2024-09-17T16:39:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T16:39:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T16:39:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T16:39:46.973 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T16:39:47.027 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T16:39:47.032 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T16:39:47.061 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:47.091 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T16:39:47.230 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:47.257 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T16:39:47.257 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:47.258 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:47.496 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-fuse 2024-09-17T16:39:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:47.514 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:47.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:47.514 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:47.612 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T16:39:47.695 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T16:39:47.745 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-mirror 2024-09-17T16:39:47.762 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T16:39:47.787 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:47.806 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:47.806 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/6 2024-09-17T16:39:47.806 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T16:39:47.807 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T16:39:47.807 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T16:39:47.807 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T16:39:48.077 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:48.078 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:48.099 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:34 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:48.237 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:48.237 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 899 k 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout:Install 2 Packages 2024-09-17T16:39:48.238 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:48.239 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 979 k 2024-09-17T16:39:48.239 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 2.9 M 2024-09-17T16:39:48.239 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:48.327 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-fuse 2024-09-17T16:39:48.331 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:48.385 INFO:teuthology.orchestra.run.smithi060.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 809 kB/s | 80 kB 00:00 2024-09-17T16:39:48.468 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:48.469 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.2 M 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 3.2 M 2024-09-17T16:39:48.471 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 14 M 2024-09-17T16:39:48.471 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:48.528 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 6/6 2024-09-17T16:39:48.528 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 1/6 2024-09-17T16:39:48.529 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T16:39:48.529 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T16:39:48.529 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T16:39:48.529 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T16:39:48.560 INFO:teuthology.orchestra.run.smithi060.stdout:(2/2): ceph-fuse-19.3.0-4975.g1889a165.el9.x86_ 3.2 MB/s | 899 kB 00:00 2024-09-17T16:39:48.560 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:48.561 INFO:teuthology.orchestra.run.smithi060.stdout:Total 3.0 MB/s | 979 kB 00:00 2024-09-17T16:39:48.573 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:48.595 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:48.595 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:48.683 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:48.683 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:48.793 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-mirror-19.3.0-4975.g1889a165.el9.x86_64.rpm 9.9 MB/s | 3.2 MB 00:00 2024-09-17T16:39:48.794 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:48.794 INFO:teuthology.orchestra.run.smithi111.stdout:Total 9.8 MB/s | 3.2 MB 00:00 2024-09-17T16:39:48.794 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:48.803 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:48.803 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:48.831 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T16:39:48.831 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:48.831 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:48.831 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:48.831 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T16:39:48.832 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T16:39:48.832 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T16:39:48.832 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T16:39:48.832 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T16:39:48.832 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:48.832 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:48.880 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:48.884 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:48.885 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:48.907 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:49.034 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T16:39:49.039 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:49.040 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:49.040 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 899 k 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:49.041 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:49.042 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:49.042 INFO:teuthology.orchestra.run.smithi183.stdout:Install 2 Packages 2024-09-17T16:39:49.042 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:49.042 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 979 k 2024-09-17T16:39:49.042 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.9 M 2024-09-17T16:39:49.042 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:49.086 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-fuse 2024-09-17T16:39:49.104 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:49.216 INFO:teuthology.orchestra.run.smithi183.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 516 kB/s | 80 kB 00:00 2024-09-17T16:39:49.321 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:49.358 INFO:teuthology.orchestra.run.smithi183.stdout:(2/2): ceph-fuse-19.3.0-4975.g1889a165.el9.x86_ 3.0 MB/s | 899 kB 00:00 2024-09-17T16:39:49.359 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:49.359 INFO:teuthology.orchestra.run.smithi183.stdout:Total 3.0 MB/s | 979 kB 00:00 2024-09-17T16:39:49.371 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:49.386 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:49.392 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:49.392 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:49.411 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:49.411 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:49.411 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T16:39:49.411 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:39:49.412 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:39:49.412 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:49.475 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:49.475 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:49.658 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:49.790 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:49.790 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:49.790 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:49.790 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:49.790 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 899 k 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout:Install 2 Packages 2024-09-17T16:39:49.791 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:49.792 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 979 k 2024-09-17T16:39:49.792 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 2.9 M 2024-09-17T16:39:49.792 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:49.800 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/2 2024-09-17T16:39:49.810 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T16:39:49.891 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T16:39:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:50.079 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T16:39:50.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:50.080 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:50.167 INFO:teuthology.orchestra.run.smithi098.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 831 kB/s | 80 kB 00:00 2024-09-17T16:39:50.359 INFO:teuthology.orchestra.run.smithi098.stdout:(2/2): ceph-fuse-19.3.0-4975.g1889a165.el9.x86_ 3.1 MB/s | 899 kB 00:00 2024-09-17T16:39:50.359 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:50.359 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.7 MB/s | 979 kB 00:00 2024-09-17T16:39:50.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-volume 2024-09-17T16:39:50.370 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:50.391 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:50.472 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:50.504 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:50.504 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:50.504 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:50.563 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:50.563 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/2 2024-09-17T16:39:50.670 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:50.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-nbd 2024-09-17T16:39:50.802 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T16:39:50.861 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T16:39:50.861 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:50.861 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:50.861 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T16:39:50.861 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:50.862 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:50.865 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:50.983 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:51.122 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 285 k 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:51.221 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:51.222 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:39:51.222 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:51.222 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 285 k 2024-09-17T16:39:51.222 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 1.3 M 2024-09-17T16:39:51.222 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:51.222 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-volume 2024-09-17T16:39:51.348 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-volume-19.3.0-4975.g1889a165.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-17T16:39:51.348 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:51.348 INFO:teuthology.orchestra.run.smithi060.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-17T16:39:51.349 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:51.358 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:51.358 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:51.362 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:54 ago on Tue 17 Sep 2024 04:37:57 PM UTC. 2024-09-17T16:39:51.391 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:51.391 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:51.497 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-17T16:39:51.498 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:51.498 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-17T16:39:51.498 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:51.498 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-17T16:39:51.498 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 170 k 2024-09-17T16:39:51.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 170 k 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 490 k 2024-09-17T16:39:51.499 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-17T16:39:51.551 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2/2 2024-09-17T16:39:51.551 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/2 2024-09-17T16:39:51.663 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:51.714 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-nbd-19.3.0-4975.g1889a165.el9.x86_64.rpm 793 kB/s | 170 kB 00:00 2024-09-17T16:39:51.715 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:51.715 INFO:teuthology.orchestra.run.smithi111.stdout:Total 787 kB/s | 170 kB 00:00 2024-09-17T16:39:51.715 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-17T16:39:51.723 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-17T16:39:51.723 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-17T16:39:51.732 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:51.751 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:51.751 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:51.751 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T16:39:51.752 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:51.791 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-17T16:39:51.791 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-17T16:39:51.822 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:36 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:51.839 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T16:39:51.840 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:51.840 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:51.840 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T16:39:51.840 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:51.840 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:51.949 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-17T16:39:51.955 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 285 k 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:51.956 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:51.957 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:39:51.957 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:51.957 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 285 k 2024-09-17T16:39:51.957 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.3 M 2024-09-17T16:39:51.957 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:52.063 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:52.116 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-volume 2024-09-17T16:39:52.197 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-volume-19.3.0-4975.g1889a165.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-17T16:39:52.197 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:52.197 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-17T16:39:52.197 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:52.205 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:52.205 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:52.235 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:52.236 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:52.459 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:52.522 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:52.539 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:52.539 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:52.539 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T16:39:52.539 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:52.539 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:52.696 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:52.806 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-17T16:39:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:52.806 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:39:52.806 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-17T16:39:52.833 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-4975.g1889a165.el9 ceph-noarch 285 k 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 285 k 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 1.3 M 2024-09-17T16:39:52.834 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:52.865 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:52.866 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:52.866 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:53.027 DEBUG:teuthology.parallel:result is None 2024-09-17T16:39:53.048 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-volume-19.3.0-4975.g1889a165.el9.noarch.rp 1.3 MB/s | 285 kB 00:00 2024-09-17T16:39:53.049 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:53.049 INFO:teuthology.orchestra.run.smithi098.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-17T16:39:53.049 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:53.057 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:53.057 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:53.085 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:53.086 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:53.170 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados-devel 2024-09-17T16:39:53.302 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:53.375 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:53.391 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:39:53.391 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T16:39:53.391 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:53.552 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:53.552 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:53.553 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:53.553 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:53.553 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:53.553 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:53.781 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:53.837 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados-devel 2024-09-17T16:39:53.921 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:53.921 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 126 k 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 126 k 2024-09-17T16:39:53.922 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 456 k 2024-09-17T16:39:53.923 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:54.135 INFO:teuthology.orchestra.run.smithi060.stdout:librados-devel-19.3.0-4975.g1889a165.el9.x86_64 595 kB/s | 126 kB 00:00 2024-09-17T16:39:54.136 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:54.136 INFO:teuthology.orchestra.run.smithi060.stdout:Total 590 kB/s | 126 kB 00:00 2024-09-17T16:39:54.136 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:54.142 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:54.143 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:54.211 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:54.211 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:54.372 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 1/1 2024-09-17T16:39:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:54.428 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-4975.g1889a165.el9.noarch 2024-09-17T16:39:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:54.429 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:54.432 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:39 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:54.478 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:54.569 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 126 k 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:39:54.570 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:54.571 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 126 k 2024-09-17T16:39:54.571 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 456 k 2024-09-17T16:39:54.571 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:54.747 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados-devel 2024-09-17T16:39:54.785 INFO:teuthology.orchestra.run.smithi183.stdout:librados-devel-19.3.0-4975.g1889a165.el9.x86_64 591 kB/s | 126 kB 00:00 2024-09-17T16:39:54.785 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:54.786 INFO:teuthology.orchestra.run.smithi183.stdout:Total 587 kB/s | 126 kB 00:00 2024-09-17T16:39:54.786 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:54.791 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:54.791 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:54.856 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:54.856 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:54.997 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:55.023 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:55.132 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:55.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:55.266 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:55.266 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:55.266 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:55.266 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:55.266 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:55.339 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:55.473 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:55.473 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 126 k 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:39:55.474 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:55.475 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 126 k 2024-09-17T16:39:55.475 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 456 k 2024-09-17T16:39:55.475 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:55.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs2 2024-09-17T16:39:55.567 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:55.672 INFO:teuthology.orchestra.run.smithi098.stdout:librados-devel-19.3.0-4975.g1889a165.el9.x86_64 643 kB/s | 126 kB 00:00 2024-09-17T16:39:55.673 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:55.673 INFO:teuthology.orchestra.run.smithi098.stdout:Total 638 kB/s | 126 kB 00:00 2024-09-17T16:39:55.673 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:55.678 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:55.678 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:55.742 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:55.843 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:55.843 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:55.844 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:55.844 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:55.844 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:55.844 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:55.912 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:56.004 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:56.078 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs2 2024-09-17T16:39:56.122 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:56.219 INFO:teuthology.orchestra.run.smithi060.stdout:Package libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:56.266 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:56.267 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:39:56.268 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:56.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install libcephfs-devel 2024-09-17T16:39:56.468 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:56.674 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:56.739 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:56.739 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:56.739 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:56.739 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:56.739 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:56.739 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:56.767 INFO:teuthology.orchestra.run.smithi183.stdout:Package libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:56.812 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:56.812 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:39:56.813 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:56.883 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs-devel 2024-09-17T16:39:56.935 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:57.012 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs2 2024-09-17T16:39:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 32 k 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:57.073 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:39:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:39:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:39:57.074 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 32 k 2024-09-17T16:39:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 142 k 2024-09-17T16:39:57.074 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:39:57.223 INFO:teuthology.orchestra.run.smithi060.stdout:libcephfs-devel-19.3.0-4975.g1889a165.el9.x86_6 213 kB/s | 32 kB 00:00 2024-09-17T16:39:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:Total 211 kB/s | 32 kB 00:00 2024-09-17T16:39:57.224 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:39:57.227 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:39:57.228 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:39:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:39:57.254 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:39:57.347 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:39:57.464 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:57.471 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:57.598 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:57.604 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 32 k 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:57.605 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:39:57.606 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:39:57.606 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:39:57.606 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:57.606 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 32 k 2024-09-17T16:39:57.606 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 142 k 2024-09-17T16:39:57.606 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:39:57.691 INFO:teuthology.orchestra.run.smithi098.stdout:Package libcephfs2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:57.735 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:57.736 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:39:57.736 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:57.755 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs-devel-19.3.0-4975.g1889a165.el9.x86_6 212 kB/s | 32 kB 00:00 2024-09-17T16:39:57.756 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:57.756 INFO:teuthology.orchestra.run.smithi183.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-17T16:39:57.756 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:39:57.760 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:39:57.760 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:39:57.776 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:39:57.776 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:39:57.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install libcephfs-devel 2024-09-17T16:39:57.856 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:57.864 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:39:57.978 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:58.097 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:58.097 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:58.097 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:39:58.097 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:58.097 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:39:58.097 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:58.279 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librados2 2024-09-17T16:39:58.367 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:58.367 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:39:58.500 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:39:58.500 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:58.500 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-17T16:39:58.500 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:58.500 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:39:58.500 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-4975.g1889a165.el9 ceph 32 k 2024-09-17T16:39:58.501 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:58.501 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:39:58.501 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:39:58.501 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:39:58.501 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:58.501 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 32 k 2024-09-17T16:39:58.502 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 142 k 2024-09-17T16:39:58.502 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:39:58.600 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:58.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:58.600 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:39:58.600 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:58.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:39:58.600 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:58.651 INFO:teuthology.orchestra.run.smithi098.stdout:libcephfs-devel-19.3.0-4975.g1889a165.el9.x86_6 212 kB/s | 32 kB 00:00 2024-09-17T16:39:58.652 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:39:58.652 INFO:teuthology.orchestra.run.smithi098.stdout:Total 211 kB/s | 32 kB 00:00 2024-09-17T16:39:58.652 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:39:58.655 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:39:58.655 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:39:58.683 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:39:58.683 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:39:58.766 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:39:58.769 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados2 2024-09-17T16:39:58.873 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:58.883 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:58.976 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:59.024 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:59.025 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:39:59.025 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:59.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install librbd1 2024-09-17T16:39:59.220 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:59.352 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:39:59.441 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:39:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:59.465 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:39:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:39:59.465 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:39:59.466 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:39:59.484 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:39:59.485 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:39:59.486 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:39:59.546 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librbd1 2024-09-17T16:39:59.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librados2 2024-09-17T16:39:59.697 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:39:59.789 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:39:59.835 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:39:59.836 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:39:59.836 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:39:59.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rados 2024-09-17T16:40:00.127 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:00.209 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:00.216 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:00.260 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:00.261 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:40:00.261 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:00.298 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:00.320 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rados 2024-09-17T16:40:00.340 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:00.341 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:40:00.341 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:00.406 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install librbd1 2024-09-17T16:40:00.511 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:00.606 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:00.652 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:00.653 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:40:00.653 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:00.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rgw 2024-09-17T16:40:00.896 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:00.985 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:00.985 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:01.030 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:01.031 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:40:01.031 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:01.073 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:01.098 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rgw 2024-09-17T16:40:01.116 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:01.117 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:40:01.118 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:01.180 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rados 2024-09-17T16:40:01.315 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:01.408 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:01.454 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:01.455 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:40:01.455 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:01.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-cephfs 2024-09-17T16:40:01.675 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:01.755 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:01.763 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:01.806 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:01.807 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:40:01.808 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:01.844 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rados-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:01.869 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-cephfs 2024-09-17T16:40:01.887 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:01.888 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:40:01.888 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:01.942 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rgw 2024-09-17T16:40:02.114 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:02.207 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:02.253 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:02.254 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:40:02.254 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:02.313 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install python3-rbd 2024-09-17T16:40:02.439 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:02.515 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:02.528 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:02.573 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:02.574 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:40:02.574 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:02.605 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rgw-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:02.638 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rbd 2024-09-17T16:40:02.649 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:02.650 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:40:02.650 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:02.711 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-cephfs 2024-09-17T16:40:02.908 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:03.001 INFO:teuthology.orchestra.run.smithi060.stdout:Package python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:03.047 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:03.048 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-09-17T16:40:03.048 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:03.106 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-fuse 2024-09-17T16:40:03.219 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:03.281 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:50 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:03.309 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:03.353 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:03.354 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2024-09-17T16:40:03.354 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:03.370 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-cephfs-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:03.411 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-fuse 2024-09-17T16:40:03.412 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:03.414 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:40:03.414 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:03.477 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install python3-rbd 2024-09-17T16:40:03.712 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:03.849 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 85 k 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:40:03.850 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:03.851 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 85 k 2024-09-17T16:40:03.851 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 231 k 2024-09-17T16:40:03.851 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:40:03.989 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:04.050 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:04.074 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-fuse-19.3.0-4975.g1889a165.el9.x86_64.rpm 382 kB/s | 85 kB 00:00 2024-09-17T16:40:04.075 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:04.075 INFO:teuthology.orchestra.run.smithi060.stdout:Total 379 kB/s | 85 kB 00:00 2024-09-17T16:40:04.075 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:40:04.083 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:40:04.083 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:40:04.122 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:04.122 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:04.122 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-09-17T16:40:04.122 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:04.122 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:40:04.122 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 85 k 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 85 k 2024-09-17T16:40:04.123 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 231 k 2024-09-17T16:40:04.124 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:40:04.138 INFO:teuthology.orchestra.run.smithi098.stdout:Package python3-rbd-2:19.3.0-4975.g1889a165.el9.x86_64 is already installed. 2024-09-17T16:40:04.150 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:40:04.151 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:40:04.181 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout:Nothing to do. 2024-09-17T16:40:04.182 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:04.242 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-fuse 2024-09-17T16:40:04.308 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:40:04.351 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-fuse-19.3.0-4975.g1889a165.el9.x86_64.rpm 375 kB/s | 85 kB 00:00 2024-09-17T16:40:04.351 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:04.351 INFO:teuthology.orchestra.run.smithi183.stdout:Total 373 kB/s | 85 kB 00:00 2024-09-17T16:40:04.352 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:40:04.359 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:40:04.359 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:40:04.411 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:04.421 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:40:04.422 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:40:04.566 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:40:04.656 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:04.817 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:04.826 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:04.961 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:04.961 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:04.961 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-17T16:40:04.961 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-4975.g1889a165.el9 ceph 85 k 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 85 k 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 231 k 2024-09-17T16:40:04.962 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:40:05.072 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:05.073 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:05.073 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:40:05.073 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:05.073 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:05.073 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:05.078 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:05.171 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-fuse-19.3.0-4975.g1889a165.el9.x86_64.rpm 409 kB/s | 85 kB 00:00 2024-09-17T16:40:05.171 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:05.172 INFO:teuthology.orchestra.run.smithi098.stdout:Total 406 kB/s | 85 kB 00:00 2024-09-17T16:40:05.172 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:40:05.179 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:40:05.179 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:40:05.242 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:40:05.242 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:40:05.344 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:05.344 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:05.344 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:40:05.344 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:05.345 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:05.345 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:05.388 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:40:05.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-mirror 2024-09-17T16:40:05.485 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:05.631 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-mirror 2024-09-17T16:40:05.878 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:06.081 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:52 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:06.139 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:40:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:06.139 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:06.139 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:06.223 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:06.224 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:06.224 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repo Size 2024-09-17T16:40:06.224 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:06.224 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.2 M 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 3.2 M 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 14 M 2024-09-17T16:40:06.225 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:40:06.240 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:51 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:06.379 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.2 M 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:40:06.380 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:06.381 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:40:06.381 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:06.381 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 3.2 M 2024-09-17T16:40:06.381 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 14 M 2024-09-17T16:40:06.381 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:40:06.424 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-mirror 2024-09-17T16:40:07.016 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:54 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:07.155 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:07.155 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repo Size 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-4975.g1889a165.el9 ceph 3.2 M 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 3.2 M 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 14 M 2024-09-17T16:40:07.156 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:40:07.429 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-mirror-19.3.0-4975.g1889a165.el9.x86_64.rpm 2.6 MB/s | 3.2 MB 00:01 2024-09-17T16:40:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:Total 2.6 MB/s | 3.2 MB 00:01 2024-09-17T16:40:07.430 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:40:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:40:07.442 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:40:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:40:07.532 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:40:07.613 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-mirror-19.3.0-4975.g1889a165.el9.x86_64.rpm 2.6 MB/s | 3.2 MB 00:01 2024-09-17T16:40:07.614 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:07.614 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.6 MB/s | 3.2 MB 00:01 2024-09-17T16:40:07.615 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:40:07.624 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:40:07.624 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:40:07.707 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:40:07.707 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:40:08.001 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:40:08.071 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:08.099 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:40:08.099 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T16:40:08.099 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:40:08.099 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:40:08.099 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:08.143 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:40:08.209 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-mirror-19.3.0-4975.g1889a165.el9.x86_64.rpm 3.0 MB/s | 3.2 MB 00:01 2024-09-17T16:40:08.210 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:08.210 INFO:teuthology.orchestra.run.smithi098.stdout:Total 3.0 MB/s | 3.2 MB 00:01 2024-09-17T16:40:08.211 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:40:08.220 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:40:08.220 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:40:08.239 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:08.265 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:08.265 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:40:08.265 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T16:40:08.265 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:40:08.265 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:40:08.265 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:08.303 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:40:08.303 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:40:08.750 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:40:08.818 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:08.843 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:08.843 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T16:40:08.843 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T16:40:08.843 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:40:08.843 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T16:40:08.844 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:09.215 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:09.215 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:09.215 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:40:09.215 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:09.215 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:09.215 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:09.398 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:09.398 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:09.398 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:40:09.398 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:09.398 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:09.398 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:09.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install rbd-nbd 2024-09-17T16:40:09.637 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-nbd 2024-09-17T16:40:10.003 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:10.004 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:10.004 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:40:10.004 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:10.004 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:10.004 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:10.077 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:01:56 ago on Tue 17 Sep 2024 04:38:14 PM UTC. 2024-09-17T16:40:10.216 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 170 k 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout:Install 1 Package 2024-09-17T16:40:10.217 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:10.218 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 170 k 2024-09-17T16:40:10.218 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 490 k 2024-09-17T16:40:10.218 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-17T16:40:10.237 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:55 ago on Tue 17 Sep 2024 04:38:15 PM UTC. 2024-09-17T16:40:10.254 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install rbd-nbd 2024-09-17T16:40:10.372 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-17T16:40:10.373 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:10.373 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2024-09-17T16:40:10.373 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 170 k 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 170 k 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 490 k 2024-09-17T16:40:10.374 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-17T16:40:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:rbd-nbd-19.3.0-4975.g1889a165.el9.x86_64.rpm 795 kB/s | 170 kB 00:00 2024-09-17T16:40:10.432 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:Total 791 kB/s | 170 kB 00:00 2024-09-17T16:40:10.433 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-17T16:40:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-17T16:40:10.441 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-17T16:40:10.510 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-17T16:40:10.510 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-17T16:40:10.592 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-nbd-19.3.0-4975.g1889a165.el9.x86_64.rpm 784 kB/s | 170 kB 00:00 2024-09-17T16:40:10.592 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:10.593 INFO:teuthology.orchestra.run.smithi183.stdout:Total 778 kB/s | 170 kB 00:00 2024-09-17T16:40:10.593 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-17T16:40:10.600 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-17T16:40:10.601 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-17T16:40:10.666 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-17T16:40:10.666 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-17T16:40:10.675 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-17T16:40:10.774 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:10.814 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-17T16:40:10.842 INFO:teuthology.orchestra.run.smithi098.stdout:Last metadata expiration check: 0:01:57 ago on Tue 17 Sep 2024 04:38:13 PM UTC. 2024-09-17T16:40:10.915 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:10.976 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-17T16:40:10.976 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout: Package Architecture Version Repository Size 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-4975.g1889a165.el9 ceph 170 k 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:================================================================================ 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:Install 1 Package 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 170 k 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:Installed size: 490 k 2024-09-17T16:40:10.977 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-17T16:40:11.178 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:11.189 INFO:teuthology.orchestra.run.smithi098.stdout:rbd-nbd-19.3.0-4975.g1889a165.el9.x86_64.rpm 805 kB/s | 170 kB 00:00 2024-09-17T16:40:11.189 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-17T16:40:11.190 INFO:teuthology.orchestra.run.smithi098.stdout:Total 800 kB/s | 170 kB 00:00 2024-09-17T16:40:11.190 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-17T16:40:11.197 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-17T16:40:11.197 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-17T16:40:11.261 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-17T16:40:11.261 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-17T16:40:11.376 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:11.410 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-17T16:40:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:11.413 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-17T16:40:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:11.413 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:11.413 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-17T16:40:11.519 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:11.654 DEBUG:teuthology.parallel:result is None 2024-09-17T16:40:11.658 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:11.658 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:11.658 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-17T16:40:11.659 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:11.659 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:11.659 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-17T16:40:11.888 DEBUG:teuthology.parallel:result is None 2024-09-17T16:40:11.953 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 1/1 2024-09-17T16:40:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:12.230 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-17T16:40:12.230 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-4975.g1889a165.el9.x86_64 2024-09-17T16:40:12.231 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:12.231 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-17T16:40:12.433 DEBUG:teuthology.parallel:result is None 2024-09-17T16:40:12.434 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:40:12.583 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T16:40:12.610 INFO:teuthology.orchestra.run.smithi060.stdout:19.3.0-4975.g1889a165.el9 2024-09-17T16:40:12.611 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975.g1889a165.el9 2024-09-17T16:40:12.611 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975.g1889a165 is installed. 2024-09-17T16:40:12.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:40:12.763 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T16:40:12.785 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-4975.g1889a165.el9 2024-09-17T16:40:12.785 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975.g1889a165.el9 2024-09-17T16:40:12.785 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975.g1889a165 is installed. 2024-09-17T16:40:12.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:40:12.932 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T16:40:12.957 INFO:teuthology.orchestra.run.smithi111.stdout:19.3.0-4975.g1889a165.el9 2024-09-17T16:40:12.958 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975.g1889a165.el9 2024-09-17T16:40:12.958 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975.g1889a165 is installed. 2024-09-17T16:40:12.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1889a165b5128787ec693450a3d1c5df5d6dc203 2024-09-17T16:40:13.105 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T16:40:13.130 INFO:teuthology.orchestra.run.smithi183.stdout:19.3.0-4975.g1889a165.el9 2024-09-17T16:40:13.130 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4975.g1889a165.el9 2024-09-17T16:40:13.131 INFO:teuthology.task.install:The correct ceph version 19.3.0-4975.g1889a165 is installed. 2024-09-17T16:40:13.133 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T16:40:13.133 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:13.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T16:40:13.165 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:13.165 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T16:40:13.195 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:13.195 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T16:40:13.227 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:13.227 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T16:40:13.256 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T16:40:13.257 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:13.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T16:40:13.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T16:40:13.358 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:13.358 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T16:40:13.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T16:40:13.456 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:13.457 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T16:40:13.486 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T16:40:13.556 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:13.556 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T16:40:13.585 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T16:40:13.654 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T16:40:13.654 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:13.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T16:40:13.685 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T16:40:13.755 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:13.755 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T16:40:13.784 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T16:40:13.854 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:13.854 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T16:40:13.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T16:40:13.952 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:13.953 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T16:40:13.982 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T16:40:14.050 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T16:40:14.050 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:14.050 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T16:40:14.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T16:40:14.151 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:14.152 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T16:40:14.181 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T16:40:14.249 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:14.249 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T16:40:14.278 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T16:40:14.348 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:14.348 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T16:40:14.377 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T16:40:14.446 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T16:40:14.544 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T16:40:14.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2024-09-17T16:40:14.548 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /var/log/ceph 2024-09-17T16:40:14.551 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-09-17T16:40:14.554 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2024-09-17T16:40:14.581 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T16:40:14.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T16:40:14.620 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T16:40:14.623 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T16:40:14.625 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T16:40:14.654 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T16:40:14.654 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T16:40:14.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T16:40:14.695 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T16:40:14.697 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T16:40:14.737 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T16:40:14.737 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T16:40:14.737 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084', 'branch': 'wip-bharath10-testing-2024-09-17-1348', 'description': 'rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zlib} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'job_id': '7909084', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'owner': 'scheduled_skanta@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 3421, 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath10-testing-2024-09-17-1348', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1889a165b5128787ec693450a3d1c5df5d6dc203/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'targets': {'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCMrkOwHr4RJUGACr1IaaLBp39mGlS2OcsH3TpbQO0/Fihokeag1JyHgN9gnF7CQixYQK3J9fmLHjK1gqhSAcbI=', 'smithi098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCCj6mZULdeO8A3yDfcxtIzHFZKlJv6deCOn/MxewJoJBJIbiSYvKUHewbmz9w1x2puH6PKBbPEx5rlrc0vaNYo=', 'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwlriYrQpQPSt7huiN82c8YQCAWUPj5khhOrH0N3EvlBdQjx35LWk5GAL5YOZxSrR9V/xV6M+hiI5aCRtA8308=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO28man8ZYL6/OISsKR05uz+dKIS5jNIvUwbEXyULPGP/G4KJqUpPScWn18Cr7zON+6CVGjQH0SYzk5JBvZHIpA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203', 'cluster': 'ceph'}}, {'thrashosds': {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_15:01:33', 'tube': 'smithi', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T16:40:14.738 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T16:40:14.764 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T16:40:14.766 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T16:40:14.769 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T16:40:14.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T16:40:14.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T16:40:14.825 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T16:40:14.828 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T16:40:14.855 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:14.855 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T16:40:14.909 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T16:40:14.909 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-17 16:40:08.344558035 +0000 2024-09-17T16:40:14.967 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-17 16:37:12.784636544 +0000 2024-09-17T16:40:14.968 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-17 16:37:12.784636544 +0000 2024-09-17T16:40:14.968 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-17 16:37:12.784636544 +0000 2024-09-17T16:40:14.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T16:40:15.034 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-17T16:40:15.034 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-17T16:40:15.034 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000112344 s, 4.6 MB/s 2024-09-17T16:40:15.035 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T16:40:15.093 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-17T16:40:15.150 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T16:40:15.150 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:15.150 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T16:40:15.150 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:15.151 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:15.151 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-17 16:40:08.344558035 +0000 2024-09-17T16:40:15.151 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-17 16:37:13.110633944 +0000 2024-09-17T16:40:15.151 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-17 16:37:13.110633944 +0000 2024-09-17T16:40:15.151 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-17 16:37:13.110633944 +0000 2024-09-17T16:40:15.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T16:40:15.216 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-17T16:40:15.216 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-17T16:40:15.216 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 9.2931e-05 s, 5.5 MB/s 2024-09-17T16:40:15.217 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T16:40:15.274 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-17T16:40:15.331 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-17 16:40:08.344558035 +0000 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-17 16:37:13.430631392 +0000 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-17 16:37:13.430631392 +0000 2024-09-17T16:40:15.332 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-17 16:37:13.430631392 +0000 2024-09-17T16:40:15.333 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T16:40:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-17T16:40:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-17T16:40:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000105897 s, 4.8 MB/s 2024-09-17T16:40:15.398 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T16:40:15.456 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-17T16:40:15.512 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T16:40:15.512 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:15.512 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T16:40:15.512 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:15.513 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:15.513 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-17 16:40:08.345558026 +0000 2024-09-17T16:40:15.513 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-17 16:37:13.762628744 +0000 2024-09-17T16:40:15.513 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-17 16:37:13.762628744 +0000 2024-09-17T16:40:15.513 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-17 16:37:13.762628744 +0000 2024-09-17T16:40:15.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T16:40:15.576 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-17T16:40:15.577 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-17T16:40:15.577 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.0001031 s, 5.0 MB/s 2024-09-17T16:40:15.578 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T16:40:15.636 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:15.637 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:15.637 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T16:40:15.656 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T16:40:15.657 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-17T16:40:15.715 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 16:40:09.092454018 +0000 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 16:37:08.254502408 +0000 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 16:37:08.254502408 +0000 2024-09-17T16:40:15.716 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 16:37:08.254502408 +0000 2024-09-17T16:40:15.716 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T16:40:15.784 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T16:40:15.784 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T16:40:15.784 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000277314 s, 1.8 MB/s 2024-09-17T16:40:15.785 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T16:40:15.845 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-17T16:40:15.904 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T16:40:15.904 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:15.904 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T16:40:15.904 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:15.905 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:15.905 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 16:40:09.093454005 +0000 2024-09-17T16:40:15.905 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 16:37:08.564498241 +0000 2024-09-17T16:40:15.905 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 16:37:08.564498241 +0000 2024-09-17T16:40:15.905 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 16:37:08.564498241 +0000 2024-09-17T16:40:15.905 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T16:40:15.971 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T16:40:15.971 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T16:40:15.971 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000217588 s, 2.4 MB/s 2024-09-17T16:40:15.972 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T16:40:16.030 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 16:40:09.093454005 +0000 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 16:37:08.886493914 +0000 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 16:37:08.886493914 +0000 2024-09-17T16:40:16.087 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 16:37:08.886493914 +0000 2024-09-17T16:40:16.088 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T16:40:16.152 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T16:40:16.153 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T16:40:16.153 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000228615 s, 2.2 MB/s 2024-09-17T16:40:16.154 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T16:40:16.211 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-17T16:40:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T16:40:16.268 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-17 16:40:09.093454005 +0000 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-17 16:37:09.221489412 +0000 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-17 16:37:09.221489412 +0000 2024-09-17T16:40:16.269 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-17 16:37:09.221489412 +0000 2024-09-17T16:40:16.269 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T16:40:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-17T16:40:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-17T16:40:16.334 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000279913 s, 1.8 MB/s 2024-09-17T16:40:16.335 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T16:40:16.393 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:16.393 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:16.393 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T16:40:16.412 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T16:40:16.413 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-09-17T16:40:16.471 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T16:40:16.471 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:16.471 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T16:40:16.471 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:16.472 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:16.472 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-17 16:39:49.659393817 +0000 2024-09-17T16:40:16.472 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-17 16:37:08.268722837 +0000 2024-09-17T16:40:16.472 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-17 16:37:08.268722837 +0000 2024-09-17T16:40:16.472 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-17 16:37:08.268722837 +0000 2024-09-17T16:40:16.472 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T16:40:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-17T16:40:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-17T16:40:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000221339 s, 2.3 MB/s 2024-09-17T16:40:16.539 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T16:40:16.597 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-17 16:39:49.660393800 +0000 2024-09-17T16:40:16.654 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-17 16:37:08.592717607 +0000 2024-09-17T16:40:16.656 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-17 16:37:08.592717607 +0000 2024-09-17T16:40:16.656 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-17 16:37:08.592717607 +0000 2024-09-17T16:40:16.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T16:40:16.719 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-17T16:40:16.720 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-17T16:40:16.720 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000216407 s, 2.4 MB/s 2024-09-17T16:40:16.721 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T16:40:16.778 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-17 16:39:49.660393800 +0000 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-17 16:37:08.920712312 +0000 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-17 16:37:08.920712312 +0000 2024-09-17T16:40:16.836 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-17 16:37:08.920712312 +0000 2024-09-17T16:40:16.837 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T16:40:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-17T16:40:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-17T16:40:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000206579 s, 2.5 MB/s 2024-09-17T16:40:16.902 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T16:40:16.959 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-09-17T16:40:17.015 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T16:40:17.015 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:17.015 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T16:40:17.015 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:17.015 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:17.015 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-17 16:39:49.660393800 +0000 2024-09-17T16:40:17.016 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-17 16:37:09.240707146 +0000 2024-09-17T16:40:17.016 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-17 16:37:09.240707146 +0000 2024-09-17T16:40:17.016 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-17 16:37:09.240707146 +0000 2024-09-17T16:40:17.016 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T16:40:17.079 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-17T16:40:17.079 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-17T16:40:17.079 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000187275 s, 2.7 MB/s 2024-09-17T16:40:17.080 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T16:40:17.136 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:17.137 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:17.137 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T16:40:17.156 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T16:40:17.156 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-09-17T16:40:17.214 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T16:40:17.214 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:17.214 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T16:40:17.214 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:17.214 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:17.215 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-17 16:40:08.516767361 +0000 2024-09-17T16:40:17.215 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-17 16:37:16.442794118 +0000 2024-09-17T16:40:17.215 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-17 16:37:16.442794118 +0000 2024-09-17T16:40:17.215 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-17 16:37:16.442794118 +0000 2024-09-17T16:40:17.215 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T16:40:17.281 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-17T16:40:17.281 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-17T16:40:17.281 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000262288 s, 2.0 MB/s 2024-09-17T16:40:17.283 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T16:40:17.342 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-09-17T16:40:17.399 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T16:40:17.399 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:17.399 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-17T16:40:17.399 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:17.399 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:17.399 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-17 16:40:08.517767334 +0000 2024-09-17T16:40:17.400 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-17 16:37:16.768785310 +0000 2024-09-17T16:40:17.400 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-17 16:37:16.768785310 +0000 2024-09-17T16:40:17.400 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-17 16:37:16.768785310 +0000 2024-09-17T16:40:17.400 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T16:40:17.465 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-17T16:40:17.465 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-17T16:40:17.465 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000212115 s, 2.4 MB/s 2024-09-17T16:40:17.466 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T16:40:17.523 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-17 16:40:08.517767334 +0000 2024-09-17T16:40:17.580 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-17 16:37:17.249772314 +0000 2024-09-17T16:40:17.581 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-17 16:37:17.249772314 +0000 2024-09-17T16:40:17.581 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-17 16:37:17.249772314 +0000 2024-09-17T16:40:17.581 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T16:40:17.644 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-17T16:40:17.644 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-17T16:40:17.645 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000272491 s, 1.9 MB/s 2024-09-17T16:40:17.646 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T16:40:17.703 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-09-17T16:40:17.760 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T16:40:17.760 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T16:40:17.760 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-17T16:40:17.761 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T16:40:17.761 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T16:40:17.761 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-17 16:40:08.517767334 +0000 2024-09-17T16:40:17.761 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-17 16:37:17.583763289 +0000 2024-09-17T16:40:17.761 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-17 16:37:17.583763289 +0000 2024-09-17T16:40:17.761 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-17 16:37:17.583763289 +0000 2024-09-17T16:40:17.761 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T16:40:17.824 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-17T16:40:17.824 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-17T16:40:17.824 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000187017 s, 2.7 MB/s 2024-09-17T16:40:17.825 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T16:40:17.881 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:17.881 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-17T16:40:17.882 INFO:tasks.ceph:Generating config... 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] bluestore write v2 = False 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-17T16:40:17.883 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-17T16:40:17.884 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-17T16:40:17.885 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-17T16:40:17.885 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-17T16:40:17.885 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-09-17T16:40:17.885 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-09-17T16:40:17.886 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2024-09-17T16:40:17.886 INFO:tasks.ceph:[global] osd_recovery_max_active = 10 2024-09-17T16:40:17.886 INFO:tasks.ceph:[global] osd_recovery_max_single_start = 10 2024-09-17T16:40:17.886 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T16:40:17.886 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T16:40:17.886 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T16:40:17.886 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T16:40:17.886 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T16:40:17.886 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-17T16:40:17.887 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T16:40:17.887 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T16:40:17.946 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T16:40:17.949 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T16:40:17.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:40:18.023 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.98'), ('mon.c', '172.21.15.111')] 2024-09-17T16:40:18.024 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,172.21.15.98,172.21.15.111', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2024-09-17T16:40:18.025 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:18.025 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T16:40:18.081 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.98 --add c 172.21.15.111 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:18.170 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = quincy 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:fsid a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2024-09-17T16:40:18.169422+0000 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-17T16:40:18.169422+0000 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 17 (quincy) 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.b 2024-09-17T16:40:18.171 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.c 2024-09-17T16:40:18.172 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T16:40:18.173 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T16:40:18.189 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a18a1a02-ea8d-4573-a275-cb30a154e84c... 2024-09-17T16:40:18.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T16:40:18.232 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T16:40:18.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T16:40:18.237 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T16:40:18.274 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-09-17T16:40:18.274 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2024-09-17T16:40:18.274 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T16:40:18.274 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2024-09-17T16:40:18.274 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.275 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2024-09-17T16:40:18.276 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2024-09-17T16:40:18.277 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.98,172.21.15.111" 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: mon client directed command retry = 5 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: mon election default strategy = 1 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: ms inject socket failures = 2500 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: ms tcp read timeout = 5 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: osd_recovery_max_active = 10 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: osd_recovery_max_single_start = 10 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.278 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 120 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2024-09-17T16:40:18.279 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug trim objects = true 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2024-09-17T16:40:18.280 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: debug monc = 20 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore compression algorithm = zlib 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore compression mode = aggressive 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore write v2 = False 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore zero block detection = True 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 20 2024-09-17T16:40:18.281 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 20 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 10 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: osd blocked scrub grace period = 3600 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug reject backfill probability = 0.3 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify cached snaps = True 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify missing on start = True 2024-09-17T16:40:18.282 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd max backfills = 3 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd max markdown count = 1000 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock override recovery settings = True 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd op queue = debug_random 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd op queue cut off = debug_random 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub min interval = 60 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: osd shutdown pgref assert = True 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-09-17T16:40:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.284 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2024-09-17T16:40:18.288 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2024-09-17T16:40:18.288 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.288 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.288 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T16:40:18.288 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T16:40:18.288 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2024-09-17T16:40:18.289 INFO:teuthology.orchestra.run.smithi060.stdout: mon scrub interval = 300 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2024-09-17T16:40:18.290 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2024-09-17T16:40:18.292 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-09-17T16:40:18.292 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-09-17T16:40:18.292 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T16:40:18.292 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-09-17T16:40:18.292 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-09-17T16:40:18.294 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T16:40:18.295 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.296 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-09-17T16:40:18.297 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.297 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-09-17T16:40:18.297 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-09-17T16:40:18.297 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-09-17T16:40:18.297 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-09-17T16:40:18.297 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.298 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.60,172.21.15.98,172.21.15.111" 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: mon client directed command retry = 5 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: mon election default strategy = 1 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject socket failures = 2500 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: ms tcp read timeout = 5 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: osd_recovery_max_active = 10 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: osd_recovery_max_single_start = 10 2024-09-17T16:40:18.299 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 120 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.300 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-09-17T16:40:18.301 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: debug monc = 20 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression algorithm = zlib 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression mode = aggressive 2024-09-17T16:40:18.302 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore write v2 = False 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore zero block detection = True 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 20 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 20 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 10 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-09-17T16:40:18.303 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-09-17T16:40:18.304 INFO:teuthology.orchestra.run.smithi111.stdout: osd blocked scrub grace period = 3600 2024-09-17T16:40:18.304 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug reject backfill probability = 0.3 2024-09-17T16:40:18.304 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify cached snaps = True 2024-09-17T16:40:18.304 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify missing on start = True 2024-09-17T16:40:18.304 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-09-17T16:40:18.304 INFO:teuthology.orchestra.run.smithi111.stdout: osd max backfills = 3 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd max markdown count = 1000 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock override recovery settings = True 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd op queue = debug_random 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd op queue cut off = debug_random 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub min interval = 60 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: osd shutdown pgref assert = True 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-17T16:40:18.305 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-09-17T16:40:18.306 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.307 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: mon scrub interval = 300 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-09-17T16:40:18.308 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout:[global] 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: chdir = "" 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: auth supported = cephx 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: filestore xattr use omap = true 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: mon clock drift allowed = 1.000 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: osd crush chooseleaf type = 0 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: auth debug = true 2024-09-17T16:40:18.309 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on old message = true 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: ms die on bug = true 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: mon pg warn max object skew = 0 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default size = 2 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow primary affinity = true 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd allow pg remap = true 2024-09-17T16:40:18.310 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on legacy crush tunables = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on crush straw calc version zero = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on no sortbitwise = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on osd down out interval zero = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon warn on too few osds = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: mon_allow_pool_size_one = true 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: osd default data pool replay window = 5 2024-09-17T16:40:18.311 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: mon allow pool delete = true 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: mon cluster log file level = debug 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: debug asserts on shutdown = true 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: mon health detail to clog = false 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: mon host = "172.21.15.60,172.21.15.98,172.21.15.111" 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: mon client directed command retry = 5 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: mon election default strategy = 1 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: ms inject socket failures = 2500 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: ms tcp read timeout = 5 2024-09-17T16:40:18.312 INFO:teuthology.orchestra.run.smithi098.stdout: osd_recovery_max_active = 10 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd_recovery_max_single_start = 10 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: fsid = a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout:[osd] 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd journal size = 100 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub load threshold = 5.0 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub max interval = 120 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock profile = high_recovery_ops 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd recover clone overlap = true 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: osd recovery max chunk = 1048576 2024-09-17T16:40:18.313 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug shutdown = true 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug op order = true 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify stray on activate = true 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug trim objects = true 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd open classes on start = true 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug pg log writeout = true 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd deep scrub update digest min age = 30 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: osd map max advance = 10 2024-09-17T16:40:18.314 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: journal zero on create = true 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: filestore ondisk finisher threads = 3 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: filestore apply finisher threads = 3 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: bdev debug aio = true 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug misdirected ops = true 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: debug monc = 20 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore block size = 96636764160 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression algorithm = zlib 2024-09-17T16:40:18.315 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore compression mode = aggressive 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore fsck on mount = True 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore write v2 = False 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: bluestore zero block detection = True 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluefs = 20 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: debug bluestore = 20 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: debug osd = 20 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: debug rocksdb = 10 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd full ratio = 0.9 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd nearfull ratio = 0.8 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: osd blocked scrub grace period = 3600 2024-09-17T16:40:18.316 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug reject backfill probability = 0.3 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify cached snaps = True 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd debug verify missing on start = True 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd failsafe full ratio = 0.95 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd max backfills = 3 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd max markdown count = 1000 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd mclock override recovery settings = True 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd objectstore = bluestore 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd op queue = debug_random 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd op queue cut off = debug_random 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd scrub min interval = 60 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: osd shutdown pgref assert = True 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr] 2024-09-17T16:40:18.317 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T16:40:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: debug mgr = 20 2024-09-17T16:40:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-17T16:40:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-17T16:40:18.318 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mgr/telemetry/nag = false 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout:[mon] 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: debug ms = 1 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: debug mon = 20 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: debug paxos = 20 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: debug auth = 20 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon data avail warn = 5 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon mgr mkfs grace = 240 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd reporter subtree level = osd 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon osd prime pg temp = true 2024-09-17T16:40:18.319 INFO:teuthology.orchestra.run.smithi098.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T16:40:18.320 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: # 1m isn't quite enough 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: mon_down_mkfs_grace = 2m 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: mon_warn_on_filestore_osds = false 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: mon scrub interval = 300 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout:[client] 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: rgw cache enabled = true 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable ops log = true 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: rgw enable usage log = true 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T16:40:18.321 INFO:teuthology.orchestra.run.smithi098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T16:40:18.322 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.a] 2024-09-17T16:40:18.322 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.b] 2024-09-17T16:40:18.322 INFO:teuthology.orchestra.run.smithi098.stdout:[mon.c] 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.323 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.324 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.325 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "172.21.15.60,172.21.15.98,172.21.15.111" 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: mon client directed command retry = 5 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: mon election default strategy = 1 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: ms inject socket failures = 2500 2024-09-17T16:40:18.326 INFO:teuthology.orchestra.run.smithi183.stdout: ms tcp read timeout = 5 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd_recovery_max_active = 10 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd_recovery_max_single_start = 10 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 120 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2024-09-17T16:40:18.327 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug trim objects = true 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2024-09-17T16:40:18.328 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: debug monc = 20 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore compression algorithm = zlib 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore compression mode = aggressive 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore write v2 = False 2024-09-17T16:40:18.329 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore zero block detection = True 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 20 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 20 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 10 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: osd blocked scrub grace period = 3600 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug reject backfill probability = 0.3 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify cached snaps = True 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify missing on start = True 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2024-09-17T16:40:18.330 INFO:teuthology.orchestra.run.smithi183.stdout: osd max backfills = 3 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd max markdown count = 1000 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock override recovery settings = True 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd op queue = debug_random 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd op queue cut off = debug_random 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub min interval = 60 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: osd shutdown pgref assert = True 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.331 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2024-09-17T16:40:18.332 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T16:40:18.333 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: mon scrub interval = 300 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T16:40:18.334 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2024-09-17T16:40:18.335 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2024-09-17T16:40:18.335 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2024-09-17T16:40:18.336 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T16:40:18.337 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T16:40:18.420 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T16:40:18.420 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:18.420 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T16:40:18.436 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:18.437 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T16:40:18.494 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:40:18.494 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:18.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T16:40:18.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:40:18.569 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:40:18.569 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:18.625 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:40:18.625 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:18.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T16:40:18.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:40:18.665 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:40:18.665 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:18.723 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:40:18.724 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:18.724 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T16:40:18.724 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:40:18.766 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:40:18.766 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:18.824 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:40:18.824 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:18.825 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T16:40:18.825 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T16:40:18.864 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:40:18.864 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:18.920 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T16:40:18.920 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T16:40:18.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T16:40:18.975 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T16:40:18.978 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T16:40:19.048 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T16:40:19.050 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T16:40:19.050 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T16:40:19.051 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T16:40:19.091 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T16:40:19.107 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T16:40:19.107 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi098.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-09-17T16:40:19.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T16:40:19.133 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:19.134 INFO:tasks.ceph:role: osd.0 2024-09-17T16:40:19.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:40:19.134 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T16:40:19.199 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:19.199 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:19.199 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:19.200 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:19.233 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-17T16:40:19.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-17T16:40:19.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T16:40:19.306 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T16:40:19.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T16:40:19.442 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:19.442 INFO:tasks.ceph:role: osd.4 2024-09-17T16:40:19.442 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:40:19.442 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:19.509 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:19.541 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-17T16:40:19.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-17T16:40:19.543 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-17T16:40:19.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T16:40:19.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-09-17T16:40:19.749 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:19.749 INFO:tasks.ceph:role: osd.8 2024-09-17T16:40:19.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:40:19.749 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T16:40:19.814 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:19.815 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:19.847 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-17T16:40:19.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-17T16:40:19.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-09-17T16:40:19.918 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-09-17T16:40:19.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2024-09-17T16:40:20.058 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:20.058 INFO:tasks.ceph:role: osd.12 2024-09-17T16:40:20.058 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:40:20.058 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T16:40:20.124 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:20.125 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:20.156 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-17T16:40:20.158 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-17T16:40:20.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2024-09-17T16:40:20.228 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2024-09-17T16:40:20.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:20.395+0000 7f0fae7bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T16:40:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:20.396+0000 7f0fae7bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T16:40:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:20.396+0000 7f0fae7bf640 -1 bdev(0x565206f2b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:20.396+0000 7f0fae7bf640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T16:40:23.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T16:40:23.344 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:23.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:23.435+0000 7f7f8161c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T16:40:23.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:23.435+0000 7f7f8161c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T16:40:23.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:23.435+0000 7f7f8161c640 -1 bdev(0x55f56d9e9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:23.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:23.435+0000 7f7f8161c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T16:40:27.093 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T16:40:27.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:27.213+0000 7f97ff9b0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-09-17T16:40:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:27.213+0000 7f97ff9b0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-09-17T16:40:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:27.213+0000 7f97ff9b0640 -1 bdev(0x55f479b4f800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:27.213+0000 7f97ff9b0640 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-09-17T16:40:30.117 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-09-17T16:40:30.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:30.238+0000 7fdfb4611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2024-09-17T16:40:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:30.239+0000 7fdfb4611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2024-09-17T16:40:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:30.239+0000 7fdfb4611640 -1 bdev(0x56087cdb9800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:30.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:40:30.239+0000 7fdfb4611640 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2024-09-17T16:40:33.656 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2024-09-17T16:40:33.687 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T16:40:33.717 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:33.717 INFO:tasks.ceph:role: osd.1 2024-09-17T16:40:33.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:40:33.717 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T16:40:33.794 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:33.795 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:34.310 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T16:40:34.312 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T16:40:34.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-17T16:40:34.429 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T16:40:34.465 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T16:40:34.532 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:34.532 INFO:tasks.ceph:role: osd.5 2024-09-17T16:40:34.532 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:40:34.532 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:34.604 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:34.605 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:34.605 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:35.066 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T16:40:35.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T16:40:35.068 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T16:40:35.163 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T16:40:35.191 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-09-17T16:40:35.257 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:35.257 INFO:tasks.ceph:role: osd.9 2024-09-17T16:40:35.257 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:40:35.257 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T16:40:35.328 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:35.329 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:35.808 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T16:40:35.810 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T16:40:35.810 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2024-09-17T16:40:35.962 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-09-17T16:40:35.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2024-09-17T16:40:36.060 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:36.060 INFO:tasks.ceph:role: osd.13 2024-09-17T16:40:36.060 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:40:36.060 DEBUG:teuthology.orchestra.run.smithi098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T16:40:36.132 INFO:teuthology.orchestra.run.smithi098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:36.132 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:36.132 INFO:teuthology.orchestra.run.smithi098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:36.132 INFO:teuthology.orchestra.run.smithi098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:36.133 INFO:teuthology.orchestra.run.smithi098.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:36.133 INFO:teuthology.orchestra.run.smithi098.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:36.133 INFO:teuthology.orchestra.run.smithi098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:36.133 INFO:teuthology.orchestra.run.smithi098.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:36.133 INFO:teuthology.orchestra.run.smithi098.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:36.133 INFO:teuthology.orchestra.run.smithi098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:36.653 INFO:teuthology.orchestra.run.smithi098.stdout:Discarding blocks...Done. 2024-09-17T16:40:36.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi098.front.sepia.ceph.com -o noatime 2024-09-17T16:40:36.655 DEBUG:teuthology.orchestra.run.smithi098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2024-09-17T16:40:36.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2024-09-17T16:40:36.829 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:36.961 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:36.959+0000 7fee69811640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T16:40:36.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:36.959+0000 7fee69811640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T16:40:36.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:36.959+0000 7fee69811640 -1 bdev(0x5599295c1800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:36.962 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:36.959+0000 7fee69811640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T16:40:40.127 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T16:40:40.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:40.245+0000 7f25df9c3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T16:40:40.247 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:40.245+0000 7f25df9c3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T16:40:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:40.245+0000 7f25df9c3640 -1 bdev(0x55e15ae4b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:40.248 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:40.245+0000 7f25df9c3640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T16:40:43.158 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T16:40:43.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:43.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:43.276+0000 7f6ba51cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-09-17T16:40:43.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:43.277+0000 7f6ba51cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-09-17T16:40:43.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:43.277+0000 7f6ba51cc640 -1 bdev(0x559842b73800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:43.280 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:43.277+0000 7f6ba51cc640 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-09-17T16:40:46.687 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-09-17T16:40:46.715 DEBUG:teuthology.orchestra.run.smithi098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:46.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:46.804+0000 7fc1db864640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2024-09-17T16:40:46.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:46.805+0000 7fc1db864640 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2024-09-17T16:40:46.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:46.805+0000 7fc1db864640 -1 bdev(0x556c4fe29800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:46.808 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-17T16:40:46.805+0000 7fc1db864640 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2024-09-17T16:40:49.976 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2024-09-17T16:40:50.006 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T16:40:50.037 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:50.038 INFO:tasks.ceph:role: osd.2 2024-09-17T16:40:50.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:40:50.038 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:50.114 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:50.591 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-17T16:40:50.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-17T16:40:50.594 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-17T16:40:50.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T16:40:50.743 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T16:40:50.811 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:50.811 INFO:tasks.ceph:role: osd.6 2024-09-17T16:40:50.811 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:40:50.811 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T16:40:50.885 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:50.886 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:51.345 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-17T16:40:51.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-17T16:40:51.347 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2024-09-17T16:40:51.440 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T16:40:51.472 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-09-17T16:40:51.539 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:51.540 INFO:tasks.ceph:role: osd.10 2024-09-17T16:40:51.540 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:40:51.540 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T16:40:51.615 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:51.615 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:51.616 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:51.616 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:51.616 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:51.616 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:51.616 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:51.617 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:51.617 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:51.617 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:52.099 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-17T16:40:52.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-17T16:40:52.101 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2024-09-17T16:40:52.226 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-09-17T16:40:52.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2024-09-17T16:40:52.324 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-09-17T16:40:52.325 INFO:tasks.ceph:role: osd.14 2024-09-17T16:40:52.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:40:52.325 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:40:52.399 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:40:52.400 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:40:52.400 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:40:52.910 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-17T16:40:52.912 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-17T16:40:52.912 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2024-09-17T16:40:53.053 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2024-09-17T16:40:53.086 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:53.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:53.203+0000 7ff8e054b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T16:40:53.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:53.204+0000 7ff8e054b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T16:40:53.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:53.204+0000 7ff8e054b640 -1 bdev(0x55a0722eb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:53.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:53.204+0000 7ff8e054b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T16:40:56.604 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T16:40:56.634 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:40:56.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:56.721+0000 7f2ab79db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T16:40:56.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:56.722+0000 7f2ab79db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T16:40:56.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:56.722+0000 7f2ab79db640 -1 bdev(0x5587d6951800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T16:40:56.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:40:56.722+0000 7f2ab79db640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T16:41:00.144 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T16:41:00.173 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:00.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:00.261+0000 7faa9c5c5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-09-17T16:41:00.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:00.261+0000 7faa9c5c5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-09-17T16:41:00.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:00.261+0000 7faa9c5c5640 -1 bdev(0x5572d295b800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2024-09-17T16:41:00.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:00.262+0000 7faa9c5c5640 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-09-17T16:41:03.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-09-17T16:41:03.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:03.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:03.297+0000 7f7206c24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2024-09-17T16:41:03.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:03.297+0000 7f7206c24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2024-09-17T16:41:03.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:03.297+0000 7f7206c24640 -1 bdev(0x5577a91bb800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2024-09-17T16:41:03.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-17T16:41:03.297+0000 7f7206c24640 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2024-09-17T16:41:06.459 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2024-09-17T16:41:06.489 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T16:41:06.520 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T16:41:06.520 INFO:tasks.ceph:role: osd.3 2024-09-17T16:41:06.520 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:41:06.520 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T16:41:06.597 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:41:06.597 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:41:06.597 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:41:06.597 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:41:06.597 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:41:06.598 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:41:06.598 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:41:06.598 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:41:06.598 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:41:06.598 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:41:07.109 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-09-17T16:41:07.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-09-17T16:41:07.111 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-17T16:41:07.260 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T16:41:07.293 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T16:41:07.359 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T16:41:07.359 INFO:tasks.ceph:role: osd.7 2024-09-17T16:41:07.359 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:41:07.359 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:41:07.431 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:41:07.432 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:41:07.432 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:41:07.432 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:41:07.881 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-09-17T16:41:07.883 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-09-17T16:41:07.883 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2024-09-17T16:41:07.971 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T16:41:08.000 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-09-17T16:41:08.065 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T16:41:08.065 INFO:tasks.ceph:role: osd.11 2024-09-17T16:41:08.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:41:08.065 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T16:41:08.137 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:41:08.137 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:41:08.138 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:41:08.628 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-09-17T16:41:08.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-09-17T16:41:08.630 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2024-09-17T16:41:08.759 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-09-17T16:41:08.788 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2024-09-17T16:41:08.853 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-09-17T16:41:08.854 INFO:tasks.ceph:role: osd.15 2024-09-17T16:41:08.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:41:08.854 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T16:41:08.926 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T16:41:09.438 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2024-09-17T16:41:09.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2024-09-17T16:41:09.440 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2024-09-17T16:41:09.579 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2024-09-17T16:41:09.609 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:09.736 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:09.734+0000 7f1ac6ab6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T16:41:09.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:09.734+0000 7f1ac6ab6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T16:41:09.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:09.734+0000 7f1ac6ab6640 -1 bdev(0x561d1ccf1800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T16:41:09.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:09.734+0000 7f1ac6ab6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T16:41:12.638 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T16:41:12.668 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:12.759 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:12.756+0000 7f0d74502640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T16:41:12.759 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:12.756+0000 7f0d74502640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T16:41:12.759 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:12.756+0000 7f0d74502640 -1 bdev(0x5623e62ab800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T16:41:12.759 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:12.756+0000 7f0d74502640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T16:41:15.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T16:41:15.702 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:15.788 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:15.785+0000 7fb4fe20e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-09-17T16:41:15.788 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:15.786+0000 7fb4fe20e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-09-17T16:41:15.789 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:15.786+0000 7fb4fe20e640 -1 bdev(0x55f781b0d800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2024-09-17T16:41:15.789 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:15.786+0000 7fb4fe20e640 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-09-17T16:41:19.212 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-09-17T16:41:19.241 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:19.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:19.330+0000 7f5e2d018640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2024-09-17T16:41:19.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:19.330+0000 7f5e2d018640 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2024-09-17T16:41:19.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:19.330+0000 7f5e2d018640 -1 bdev(0x55fdfe127800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2024-09-17T16:41:19.333 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-17T16:41:19.330+0000 7f5e2d018640 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2024-09-17T16:41:22.498 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2024-09-17T16:41:22.528 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T16:41:22.529 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:22.529 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T16:41:22.561 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:22.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T16:41:22.630 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:22.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T16:41:22.698 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:22.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-09-17T16:41:22.766 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:22.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2024-09-17T16:41:22.833 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:22.833 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T16:41:22.864 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:22.865 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T16:41:22.934 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:22.934 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-09-17T16:41:23.003 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:23.003 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2024-09-17T16:41:23.071 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:23.071 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T16:41:23.101 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:23.102 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T16:41:23.172 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:23.172 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-09-17T16:41:23.241 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:23.241 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2024-09-17T16:41:23.310 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:23.334 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T16:41:23.365 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:23.365 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T16:41:23.433 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:23.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T16:41:23.500 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:23.500 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-09-17T16:41:23.566 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:23.566 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2024-09-17T16:41:23.633 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:23.633 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T16:41:23.689 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T16:41:23.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T16:41:23.692 DEBUG:teuthology.orchestra.run.smithi098:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T16:41:23.695 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T16:41:23.719 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2024-09-17T16:41:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDysOlmybgOOhAA6ZwiNRRMqI8pDnW4vzOU+g== 2024-09-17T16:41:23.719 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2024-09-17T16:41:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQD0sOlmYDKmFxAAvZf7zenSA6qrPi4/iJBbAA== 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQD3sOlmM9H+GRAAZILB0s6CnNR0Uw36PKI1lQ== 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.8] 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQD7sOlm0w3KDBAAC+nC99/54JGM0L/odzjr9Q== 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.12] 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQD+sOlmrJhMDhAATKHCxZ0R6I1jQZSWZZ32VA== 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAEselmBbs5ORAAX3Il8+Of7sg0ZySQXd8L8w== 2024-09-17T16:41:23.720 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAIselm9ACpDhAAkVuNHD7RQQPuU8Yw1xlivw== 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.9] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQALselmJqWbEBAA9q39bjy79R2Htb2fWUlt+w== 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.13] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAOselm7mwVMBAAkLi/4EMCH1SIV8DR29AXWw== 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAVselmg280DBAAzv1KM/sap5FIOdPNGuHT8Q== 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAYselm+aETKxAAE9Q7Fub+06ORw/I7a0mSBA== 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.10] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAcselmhAWmDxAA7rturFgHn3+zVrhEsSJM2g== 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.14] 2024-09-17T16:41:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAfselmvMfHERAAtVftVCzLgeWwbrdpz5M4AA== 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDzsOlmeqvLAhAAWwPC0mxftXAWI7z2SP3tjQ== 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAlselmJK7PKxAAw2/it7Un/Q9nolF1liG/VA== 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAoselmqnomLRAAnYyQUZ3bMWg3dvFZQX4SmA== 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.11] 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQArselmU9XmLhAA2Rg9GGww2QMNJB7aiFH48g== 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.15] 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQAvselmVYbAExAAbV+VFyqtgupNGbezeLq8bg== 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-17T16:41:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDzsOlmMzlkBRAAMcHpZen9pv5hw8mHc2uaGA== 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.y] 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDysOlmybgOOhAA6ZwiNRRMqI8pDnW4vzOU+g== 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.0] 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQD0sOlmYDKmFxAAvZf7zenSA6qrPi4/iJBbAA== 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.4] 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQD3sOlmM9H+GRAAZILB0s6CnNR0Uw36PKI1lQ== 2024-09-17T16:41:23.724 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.8] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQD7sOlm0w3KDBAAC+nC99/54JGM0L/odzjr9Q== 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.12] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQD+sOlmrJhMDhAATKHCxZ0R6I1jQZSWZZ32VA== 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.1] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAEselmBbs5ORAAX3Il8+Of7sg0ZySQXd8L8w== 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.5] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAIselm9ACpDhAAkVuNHD7RQQPuU8Yw1xlivw== 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.9] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQALselmJqWbEBAA9q39bjy79R2Htb2fWUlt+w== 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.13] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAOselm7mwVMBAAkLi/4EMCH1SIV8DR29AXWw== 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.2] 2024-09-17T16:41:23.725 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAVselmg280DBAAzv1KM/sap5FIOdPNGuHT8Q== 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.6] 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAYselm+aETKxAAE9Q7Fub+06ORw/I7a0mSBA== 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.10] 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAcselmhAWmDxAA7rturFgHn3+zVrhEsSJM2g== 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.14] 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAfselmvMfHERAAtVftVCzLgeWwbrdpz5M4AA== 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout:[mgr.x] 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDzsOlmeqvLAhAAWwPC0mxftXAWI7z2SP3tjQ== 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.3] 2024-09-17T16:41:23.726 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAlselmJK7PKxAAw2/it7Un/Q9nolF1liG/VA== 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.7] 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAoselmqnomLRAAnYyQUZ3bMWg3dvFZQX4SmA== 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.11] 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQArselmU9XmLhAA2Rg9GGww2QMNJB7aiFH48g== 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout:[osd.15] 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQAvselmVYbAExAAbV+VFyqtgupNGbezeLq8bg== 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout:[client.0] 2024-09-17T16:41:23.727 INFO:teuthology.orchestra.run.smithi098.stdout: key = AQDzsOlmMzlkBRAAMcHpZen9pv5hw8mHc2uaGA== 2024-09-17T16:41:23.728 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.y] 2024-09-17T16:41:23.728 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDysOlmybgOOhAA6ZwiNRRMqI8pDnW4vzOU+g== 2024-09-17T16:41:23.728 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQD0sOlmYDKmFxAAvZf7zenSA6qrPi4/iJBbAA== 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.4] 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQD3sOlmM9H+GRAAZILB0s6CnNR0Uw36PKI1lQ== 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.8] 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQD7sOlm0w3KDBAAC+nC99/54JGM0L/odzjr9Q== 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.12] 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQD+sOlmrJhMDhAATKHCxZ0R6I1jQZSWZZ32VA== 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAEselmBbs5ORAAX3Il8+Of7sg0ZySQXd8L8w== 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.5] 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAIselm9ACpDhAAkVuNHD7RQQPuU8Yw1xlivw== 2024-09-17T16:41:23.729 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.9] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQALselmJqWbEBAA9q39bjy79R2Htb2fWUlt+w== 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.13] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAOselm7mwVMBAAkLi/4EMCH1SIV8DR29AXWw== 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAVselmg280DBAAzv1KM/sap5FIOdPNGuHT8Q== 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.6] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAYselm+aETKxAAE9Q7Fub+06ORw/I7a0mSBA== 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.10] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAcselmhAWmDxAA7rturFgHn3+zVrhEsSJM2g== 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.14] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAfselmvMfHERAAtVftVCzLgeWwbrdpz5M4AA== 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2024-09-17T16:41:23.730 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDzsOlmeqvLAhAAWwPC0mxftXAWI7z2SP3tjQ== 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAlselmJK7PKxAAw2/it7Un/Q9nolF1liG/VA== 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.7] 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoselmqnomLRAAnYyQUZ3bMWg3dvFZQX4SmA== 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.11] 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQArselmU9XmLhAA2Rg9GGww2QMNJB7aiFH48g== 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.15] 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAvselmVYbAExAAbV+VFyqtgupNGbezeLq8bg== 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-09-17T16:41:23.731 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDzsOlmMzlkBRAAMcHpZen9pv5hw8mHc2uaGA== 2024-09-17T16:41:23.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:41:23.767 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:41:23.769 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:41:23.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.829 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.832 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.888 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.891 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:23.998 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.001 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.003 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.056 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.058 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.109 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.111 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.220 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.222 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.224 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.278 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.281 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.334 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.337 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.390 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.445 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.447 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.499 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:41:24.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:41:24.504 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T16:41:24.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.558 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.561 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.612 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.614 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.616 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.670 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.672 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.723 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.725 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.727 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T16:41:24.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T16:41:24.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T16:41:24.784 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T16:41:24.837 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T16:41:24.838 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T16:41:24.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T16:41:24.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T16:41:24.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T16:41:25.011 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T16:41:25.107 DEBUG:teuthology.orchestra.run.smithi098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T16:41:25.132 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T16:41:25.158 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T16:41:25.256 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T16:41:25.281 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:25.284 DEBUG:teuthology.orchestra.run.smithi098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:25.286 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T16:41:25.336 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T16:41:25.336 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T16:41:25.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T16:41:25.340 INFO:tasks.ceph.mon.a:Started 2024-09-17T16:41:25.340 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T16:41:25.340 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T16:41:25.343 INFO:tasks.ceph.mon.b:Started 2024-09-17T16:41:25.343 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T16:41:25.343 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T16:41:25.378 INFO:tasks.ceph.mon.c:Started 2024-09-17T16:41:25.379 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T16:41:25.379 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T16:41:25.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T16:41:25.381 INFO:tasks.ceph.mgr.y:Started 2024-09-17T16:41:25.381 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T16:41:25.381 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T16:41:25.384 INFO:tasks.ceph.mgr.x:Started 2024-09-17T16:41:25.384 DEBUG:tasks.ceph:set 0 configs 2024-09-17T16:41:25.384 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T16:41:25.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T16:41:30.773 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-09-17T16:41:30.785 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T16:41:30.785 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T16:41:30.786 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:30.786 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T16:41:30.812 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:30.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T16:41:30.878 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:30.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-09-17T16:41:30.944 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-17T16:41:30.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2024-09-17T16:41:31.010 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:31.010 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T16:41:31.040 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:31.040 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T16:41:31.109 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:31.110 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-09-17T16:41:31.178 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-17T16:41:31.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2024-09-17T16:41:31.245 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:31.245 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T16:41:31.275 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:31.275 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T16:41:31.344 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:31.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-09-17T16:41:31.412 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-17T16:41:31.412 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2024-09-17T16:41:31.479 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:31.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T16:41:31.504 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:31.504 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T16:41:31.568 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:31.569 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-09-17T16:41:31.634 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-17T16:41:31.634 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2024-09-17T16:41:31.699 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new c580007f-04f5-4607-bcb0-9eca9fb6a273 0 2024-09-17T16:41:31.924 INFO:teuthology.orchestra.run.smithi183.stdout:0 2024-09-17T16:41:31.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 5068e4a5-399f-472d-bf4d-0105adfba800 1 2024-09-17T16:41:32.117 INFO:teuthology.orchestra.run.smithi183.stdout:1 2024-09-17T16:41:32.128 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d 2 2024-09-17T16:41:32.330 INFO:teuthology.orchestra.run.smithi183.stdout:2 2024-09-17T16:41:32.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new e00f6dc3-b74d-441a-abff-55ed4fba87a1 3 2024-09-17T16:41:32.518 INFO:teuthology.orchestra.run.smithi183.stdout:3 2024-09-17T16:41:32.530 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 7d0041d5-389e-4b11-b8e1-535c6113a4f7 4 2024-09-17T16:41:32.707 INFO:teuthology.orchestra.run.smithi183.stdout:4 2024-09-17T16:41:32.718 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 9fc5ba03-7465-43f6-a148-fcecb32304a7 5 2024-09-17T16:41:32.896 INFO:teuthology.orchestra.run.smithi183.stdout:5 2024-09-17T16:41:32.907 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 2f2be94b-f485-485b-9d16-80f293b0274c 6 2024-09-17T16:41:33.083 INFO:teuthology.orchestra.run.smithi183.stdout:6 2024-09-17T16:41:33.094 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new eedf3336-c9e3-4c8c-b81a-2f0ebfad326c 7 2024-09-17T16:41:33.271 INFO:teuthology.orchestra.run.smithi183.stdout:7 2024-09-17T16:41:33.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 44e1f674-128a-4388-a488-ffdec5ab479a 8 2024-09-17T16:41:33.461 INFO:teuthology.orchestra.run.smithi183.stdout:8 2024-09-17T16:41:33.472 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new c085e6d8-5929-4ab1-826e-cecb51ed73cd 9 2024-09-17T16:41:33.648 INFO:teuthology.orchestra.run.smithi183.stdout:9 2024-09-17T16:41:33.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 87248b6a-e219-48a5-911c-4995588e51a2 10 2024-09-17T16:41:33.833 INFO:teuthology.orchestra.run.smithi183.stdout:10 2024-09-17T16:41:33.845 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 21b3d129-c96b-4240-aaaf-682d06b10e50 11 2024-09-17T16:41:34.023 INFO:teuthology.orchestra.run.smithi183.stdout:11 2024-09-17T16:41:34.034 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 953f99d2-c3d1-4bac-b9c7-7f56bed3a05f 12 2024-09-17T16:41:34.213 INFO:teuthology.orchestra.run.smithi183.stdout:12 2024-09-17T16:41:34.224 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new a4d32ef9-7344-4d6e-a16c-8cc8623b23a6 13 2024-09-17T16:41:34.403 INFO:teuthology.orchestra.run.smithi183.stdout:13 2024-09-17T16:41:34.414 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 9305c16f-a01d-4eb1-95ff-df3616720e1f 14 2024-09-17T16:41:34.608 INFO:teuthology.orchestra.run.smithi183.stdout:14 2024-09-17T16:41:34.623 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 9a0ea790-a644-426d-baa7-35a2699a2123 15 2024-09-17T16:41:34.800 INFO:teuthology.orchestra.run.smithi183.stdout:15 2024-09-17T16:41:34.811 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T16:41:34.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T16:41:34.814 INFO:tasks.ceph.osd.0:Started 2024-09-17T16:41:34.814 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T16:41:34.814 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T16:41:34.816 INFO:tasks.ceph.osd.4:Started 2024-09-17T16:41:34.816 INFO:tasks.ceph.osd.8:Restarting daemon 2024-09-17T16:41:34.816 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-09-17T16:41:34.819 INFO:tasks.ceph.osd.8:Started 2024-09-17T16:41:34.819 INFO:tasks.ceph.osd.12:Restarting daemon 2024-09-17T16:41:34.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-09-17T16:41:34.822 INFO:tasks.ceph.osd.12:Started 2024-09-17T16:41:34.822 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T16:41:34.823 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T16:41:34.825 INFO:tasks.ceph.osd.1:Started 2024-09-17T16:41:34.826 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T16:41:34.826 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T16:41:34.828 INFO:tasks.ceph.osd.5:Started 2024-09-17T16:41:34.829 INFO:tasks.ceph.osd.9:Restarting daemon 2024-09-17T16:41:34.829 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-09-17T16:41:34.831 INFO:tasks.ceph.osd.9:Started 2024-09-17T16:41:34.832 INFO:tasks.ceph.osd.13:Restarting daemon 2024-09-17T16:41:34.832 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2024-09-17T16:41:34.834 INFO:tasks.ceph.osd.13:Started 2024-09-17T16:41:34.834 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T16:41:34.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T16:41:34.837 INFO:tasks.ceph.osd.2:Started 2024-09-17T16:41:34.837 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T16:41:34.837 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T16:41:34.839 INFO:tasks.ceph.osd.6:Started 2024-09-17T16:41:34.839 INFO:tasks.ceph.osd.10:Restarting daemon 2024-09-17T16:41:34.840 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-09-17T16:41:34.842 INFO:tasks.ceph.osd.10:Started 2024-09-17T16:41:34.842 INFO:tasks.ceph.osd.14:Restarting daemon 2024-09-17T16:41:34.842 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-09-17T16:41:34.844 INFO:tasks.ceph.osd.14:Started 2024-09-17T16:41:34.844 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T16:41:34.845 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T16:41:34.847 INFO:tasks.ceph.osd.3:Started 2024-09-17T16:41:34.847 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T16:41:34.847 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T16:41:34.852 INFO:tasks.ceph.osd.7:Started 2024-09-17T16:41:34.853 INFO:tasks.ceph.osd.11:Restarting daemon 2024-09-17T16:41:34.853 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-09-17T16:41:34.855 INFO:tasks.ceph.osd.11:Started 2024-09-17T16:41:34.855 INFO:tasks.ceph.osd.15:Restarting daemon 2024-09-17T16:41:34.855 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2024-09-17T16:41:34.857 INFO:tasks.ceph.osd.15:Started 2024-09-17T16:41:34.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:41:35.068 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:41:35.068 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":18,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:41:34.797369+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T16:41:34.797369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:41:35.079 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T16:41:35.079 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T16:41:35.787 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:41:35.785+0000 7fa5425b2640 -1 Falling back to public interface 2024-09-17T16:41:35.793 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:41:35.791+0000 7faa3940b640 -1 Falling back to public interface 2024-09-17T16:41:36.017 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:41:36.014+0000 7faf49d27640 -1 Falling back to public interface 2024-09-17T16:41:36.043 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:41:36.040+0000 7f378fd54640 -1 Falling back to public interface 2024-09-17T16:41:36.049 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-09-17T16:41:36.047+0000 7f330c9bd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T16:41:36.049 INFO:tasks.ceph.mgr.x.smithi183.stderr:2024-09-17T16:41:36.047+0000 7f330c9bd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T16:41:36.050 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:41:36.048+0000 7f930545e640 -1 Falling back to public interface 2024-09-17T16:41:36.058 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:41:36.056+0000 7f602cd56640 -1 Falling back to public interface 2024-09-17T16:41:36.084 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:41:36.081+0000 7f1444a2a640 -1 Falling back to public interface 2024-09-17T16:41:36.263 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:41:36.260+0000 7f074c120640 -1 Falling back to public interface 2024-09-17T16:41:36.285 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:41:36.282+0000 7f5edca19640 -1 Falling back to public interface 2024-09-17T16:41:36.285 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:41:36.283+0000 7f6835410640 -1 Falling back to public interface 2024-09-17T16:41:36.306 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:41:36.304+0000 7ff258f02640 -1 Falling back to public interface 2024-09-17T16:41:36.311 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:41:36.308+0000 7f4c0ae19640 -1 Falling back to public interface 2024-09-17T16:41:36.320 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:41:36.318+0000 7f953e545640 -1 Falling back to public interface 2024-09-17T16:41:36.527 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:41:36.525+0000 7fc796022640 -1 Falling back to public interface 2024-09-17T16:41:36.533 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:41:36.531+0000 7f4c86134640 -1 Falling back to public interface 2024-09-17T16:41:36.563 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:41:36.561+0000 7fdf7f91b640 -1 Falling back to public interface 2024-09-17T16:41:36.686 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T16:41:36.993 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-17T16:41:36.994 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":18,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:41:34.797369+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T16:41:34.797369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:41:37.005 DEBUG:teuthology.misc:0 of 16 OSDs are up 2024-09-17T16:41:39.590 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:41:39.587+0000 7fa5425b2640 -1 osd.8 0 log_to_monitors true 2024-09-17T16:41:39.604 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:41:39.602+0000 7f378fd54640 -1 osd.9 0 log_to_monitors true 2024-09-17T16:41:39.604 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:41:39.602+0000 7faa3940b640 -1 osd.5 0 log_to_monitors true 2024-09-17T16:41:39.855 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:41:39.852+0000 7f953e545640 -1 osd.7 0 log_to_monitors true 2024-09-17T16:41:39.874 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:41:39.872+0000 7f602cd56640 -1 osd.6 0 log_to_monitors true 2024-09-17T16:41:40.020 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:41:40.018+0000 7f074c120640 -1 osd.4 0 log_to_monitors true 2024-09-17T16:41:40.060 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:41:40.058+0000 7faf49d27640 -1 osd.12 0 log_to_monitors true 2024-09-17T16:41:40.077 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:41:40.075+0000 7f6835410640 -1 osd.13 0 log_to_monitors true 2024-09-17T16:41:40.091 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:41:40.089+0000 7f930545e640 -1 osd.0 0 log_to_monitors true 2024-09-17T16:41:40.117 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:41:40.115+0000 7ff258f02640 -1 osd.10 0 log_to_monitors true 2024-09-17T16:41:40.127 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:41:40.125+0000 7f1444a2a640 -1 osd.11 0 log_to_monitors true 2024-09-17T16:41:40.279 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:41:40.277+0000 7f5edca19640 -1 osd.2 0 log_to_monitors true 2024-09-17T16:41:40.294 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:41:40.292+0000 7f4c86134640 -1 osd.1 0 log_to_monitors true 2024-09-17T16:41:40.312 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:41:40.309+0000 7f4c0ae19640 -1 osd.15 0 log_to_monitors true 2024-09-17T16:41:40.527 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:41:40.524+0000 7fc796022640 -1 osd.3 0 log_to_monitors true 2024-09-17T16:41:40.657 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:41:40.655+0000 7fa53e541640 -1 osd.8 0 waiting for initial osdmap 2024-09-17T16:41:40.657 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:41:40.655+0000 7f378bce3640 -1 osd.9 0 waiting for initial osdmap 2024-09-17T16:41:40.661 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:41:40.659+0000 7fa53a368640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:40.675 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:41:40.673+0000 7f3787b0a640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:40.841 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:41:40.838+0000 7fdf7f91b640 -1 osd.14 0 log_to_monitors true 2024-09-17T16:41:41.663 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:41:41.660+0000 7f07480af640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T16:41:41.663 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:41:41.660+0000 7f93013ed640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T16:41:41.663 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:41:41.661+0000 7f5ed89a8640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T16:41:41.667 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:41:41.665+0000 7f5ed47cf640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:41.669 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:41:41.667+0000 7f6830dd9640 -1 osd.13 0 waiting for initial osdmap 2024-09-17T16:41:41.674 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:41:41.672+0000 7f682cc00640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:41.674 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:41:41.672+0000 7f0743ed6640 -1 osd.4 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:41.678 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:41:41.676+0000 7f92fd214640 -1 osd.0 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:43.334 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:41:43.332+0000 7faa34e1c640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T16:41:43.344 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:41:43.342+0000 7faa2cc3b640 -1 osd.5 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.373 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:41:44.371+0000 7f4c820c3640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T16:41:44.382 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:41:44.380+0000 7f4c79ee2640 -1 osd.1 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.439 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:41:44.436+0000 7faf45cb6640 -1 osd.12 0 waiting for initial osdmap 2024-09-17T16:41:44.455 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:41:44.453+0000 7faf3dad5640 -1 osd.12 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.547 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:41:44.544+0000 7f6028ce5640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T16:41:44.559 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:41:44.557+0000 7ff254e91640 -1 osd.10 0 waiting for initial osdmap 2024-09-17T16:41:44.561 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:41:44.559+0000 7f6020b04640 -1 osd.6 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.572 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:41:44.570+0000 7ff24ccb0640 -1 osd.10 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.614 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T16:41:44.732 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:41:44.730+0000 7f4c075bc640 -1 osd.15 0 waiting for initial osdmap 2024-09-17T16:41:44.746 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:41:44.744+0000 7f4bfebc7640 -1 osd.15 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.865 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:41:44.862+0000 7f14409b9640 -1 osd.11 0 waiting for initial osdmap 2024-09-17T16:41:44.876 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:41:44.874+0000 7f14387d8640 -1 osd.11 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.882 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:41:44.879+0000 7f953ace8640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T16:41:44.897 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:41:44.895+0000 7f95322f3640 -1 osd.7 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.898 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:41:44.896+0000 7fc792128640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T16:41:44.910 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:41:44.908+0000 7fc789733640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:44.916 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-17T16:41:44.917 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":24,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:41:44.663747+0000","last_up_change":"2024-09-17T16:41:44.663747+0000","last_in_change":"2024-09-17T16:41:34.797369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":16.670000076293945,"score_stable":16.670000076293945,"optimal_score":0.059999998658895493,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.116010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.286245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.012231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.640379+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.608180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.570621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.038949+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:41:44.928 DEBUG:teuthology.misc:11 of 16 OSDs are up 2024-09-17T16:41:45.521 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:41:45.518+0000 7fdf7b8aa640 -1 osd.14 0 waiting for initial osdmap 2024-09-17T16:41:45.531 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:41:45.529+0000 7fdf736c9640 -1 osd.14 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T16:41:52.540 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T16:41:52.848 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-17T16:41:52.848 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":26,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:41:46.666222+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:41:34.797369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.116010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.262806+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.286245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.503712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.012231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.640379+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.883245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.851004+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.608180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.570621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.142430+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.173864+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.076485+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.038949+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.842812+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.328280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:41:52.859 DEBUG:teuthology.misc:16 of 16 OSDs are up 2024-09-17T16:41:52.859 INFO:tasks.ceph:Creating RBD pool 2024-09-17T16:41:52.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T16:41:54.106 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'rbd' created 2024-09-17T16:41:54.123 DEBUG:teuthology.orchestra.run.smithi060:> rbd --cluster ceph pool init rbd 2024-09-17T16:41:57.137 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T16:41:57.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T16:41:57.139 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T16:41:57.454 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:41:57.467 INFO:teuthology.orchestra.run.smithi060.stdout:[{"version":11,"timestamp":"2024-09-17T16:41:45.520551+0000","name":"","changes":[{"name":"osd.14/osd_mclock_max_capacity_iops_ssd","new_value":"9555.186177"}]}] 2024-09-17T16:41:57.467 INFO:tasks.ceph_manager:config epoch is 11 2024-09-17T16:41:57.467 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T16:41:57.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T16:41:57.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T16:41:57.822 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:41:57.832 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":1846253199},{"type":"v1","addr":"172.21.15.183:6801","nonce":1846253199}]},"active_addr":"172.21.15.183:6801/1846253199","active_change":"2024-09-17T16:41:35.034536+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":4177797375}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":3969910625}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":1263500042}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":3679234200}]}]} 2024-09-17T16:41:57.841 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T16:41:57.842 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T16:41:57.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:41:58.144 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:41:58.144 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:41:57.116002+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:41:34.797369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T16:41:53.164635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.116010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.262806+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.286245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.503712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.012231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.640379+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.883245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.851004+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.608180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.570621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.142430+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.173864+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.076485+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.038949+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.842812+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.328280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:41:58.157 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T16:41:58.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:41:58.458 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:41:57.116002+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:41:34.797369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T16:41:53.164635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9900000095367432,"score_stable":3.9900000095367432,"optimal_score":0.68999999761581421,"raw_score_acting":2.75,"raw_score_stable":2.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.116010+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.262806+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.286245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.503712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.012231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.640379+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.883245+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.851004+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.608180+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:40.570621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.142430+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.173864+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.076485+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.038949+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.842812+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:41:41.328280+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:41:58.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T16:41:58.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T16:41:58.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T16:41:58.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T16:41:58.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T16:41:58.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T16:41:58.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T16:41:58.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T16:41:58.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-17T16:41:58.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-17T16:41:58.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-17T16:41:58.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-17T16:41:58.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-17T16:41:58.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-17T16:41:58.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-17T16:41:58.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-17T16:41:58.915 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:41:58.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-17T16:41:58.927 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:41:58.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T16:41:58.941 INFO:teuthology.orchestra.run.smithi060.stdout:103079215108 2024-09-17T16:41:58.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T16:41:58.944 INFO:teuthology.orchestra.run.smithi060.stdout:107374182405 2024-09-17T16:41:58.944 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T16:41:58.945 INFO:teuthology.orchestra.run.smithi060.stdout:103079215110 2024-09-17T16:41:58.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-17T16:41:58.964 INFO:teuthology.orchestra.run.smithi060.stdout:98784247814 2024-09-17T16:41:58.964 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T16:41:58.970 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:41:58.970 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:41:58.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T16:41:58.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T16:41:58.972 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:41:58.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-17T16:41:58.979 INFO:teuthology.orchestra.run.smithi060.stdout:90194313222 2024-09-17T16:41:58.980 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-17T16:41:58.989 INFO:teuthology.orchestra.run.smithi060.stdout:90194313222 2024-09-17T16:41:58.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-17T16:41:58.990 INFO:teuthology.orchestra.run.smithi060.stdout:103079215111 2024-09-17T16:41:58.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T16:41:59.007 INFO:teuthology.orchestra.run.smithi060.stdout:103079215110 2024-09-17T16:41:59.007 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-17T16:41:59.021 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:41:59.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-17T16:41:59.075 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:41:59.075 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T16:41:59.103 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:41:59.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-17T16:42:00.046 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:42:00.068 INFO:teuthology.orchestra.run.smithi060.stdout:107374182405 2024-09-17T16:42:00.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.2 2024-09-17T16:42:00.082 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182405 got 107374182405 for osd.7 2024-09-17T16:42:00.109 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.151 INFO:teuthology.orchestra.run.smithi060.stdout:103079215110 2024-09-17T16:42:00.160 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:42:00.172 INFO:teuthology.orchestra.run.smithi060.stdout:103079215111 2024-09-17T16:42:00.181 INFO:teuthology.orchestra.run.smithi060.stdout:98784247814 2024-09-17T16:42:00.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215110 for osd.10 2024-09-17T16:42:00.187 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.13 2024-09-17T16:42:00.191 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215111 got 103079215111 for osd.6 2024-09-17T16:42:00.207 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.220 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:42:00.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247814 got 98784247814 for osd.5 2024-09-17T16:42:00.223 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.250 INFO:teuthology.orchestra.run.smithi060.stdout:103079215110 2024-09-17T16:42:00.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182407 got 107374182407 for osd.3 2024-09-17T16:42:00.251 INFO:teuthology.orchestra.run.smithi060.stdout:90194313222 2024-09-17T16:42:00.251 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.258 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:42:00.260 INFO:teuthology.orchestra.run.smithi060.stdout:107374182406 2024-09-17T16:42:00.267 INFO:teuthology.orchestra.run.smithi060.stdout:103079215108 2024-09-17T16:42:00.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215110 for osd.12 2024-09-17T16:42:00.272 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.278 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:42:00.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182407 got 107374182407 for osd.11 2024-09-17T16:42:00.283 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.285 INFO:teuthology.orchestra.run.smithi060.stdout:94489280517 2024-09-17T16:42:00.286 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:42:00.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182407 got 107374182406 for osd.15 2024-09-17T16:42:00.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313222 for osd.8 2024-09-17T16:42:00.290 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215108 got 103079215108 for osd.1 2024-09-17T16:42:00.298 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.4 2024-09-17T16:42:00.302 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.0 2024-09-17T16:42:00.302 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182407 got 107374182407 for osd.14 2024-09-17T16:42:00.305 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:00.306 INFO:teuthology.orchestra.run.smithi060.stdout:90194313222 2024-09-17T16:42:00.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313222 got 90194313222 for osd.9 2024-09-17T16:42:00.319 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:01.291 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-17T16:42:01.607 INFO:teuthology.orchestra.run.smithi060.stdout:107374182407 2024-09-17T16:42:01.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182407 got 107374182407 for osd.15 2024-09-17T16:42:01.620 DEBUG:teuthology.parallel:result is None 2024-09-17T16:42:01.620 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T16:42:01.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:01.916 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:01.917 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:01.929 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T16:42:01.043938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":441328,"kb_used_data":4672,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509508112,"statfs":{"total":1546188226560,"available":1545736306688,"internally_reserved":0,"allocated":4784128,"data_stored":3148776,"data_compressed":190049,"data_compressed_allocated":446464,"data_compressed_original":1798144,"omap_allocated":25521,"internal_metadata":446733391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.129605+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:41:57.129605+0000","last_peered":"2024-09-17T16:41:57.129605+0000","last_clean":"2024-09-17T16:41:57.129605+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:41:57.129605+0000","last_undegraded":"2024-09-17T16:41:57.129605+0000","last_fullsized":"2024-09-17T16:41:57.129605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.095232+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:41:58.095232+0000","last_peered":"2024-09-17T16:41:58.095232+0000","last_clean":"2024-09-17T16:41:58.095232+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:41:58.095232+0000","last_undegraded":"2024-09-17T16:41:58.095232+0000","last_fullsized":"2024-09-17T16:41:58.095232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.122222+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:41:57.122222+0000","last_peered":"2024-09-17T16:41:57.122222+0000","last_clean":"2024-09-17T16:41:57.122222+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:41:57.122222+0000","last_undegraded":"2024-09-17T16:41:57.122222+0000","last_fullsized":"2024-09-17T16:41:57.122222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.186059+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:41:57.186059+0000","last_peered":"2024-09-17T16:41:57.186059+0000","last_clean":"2024-09-17T16:41:57.186059+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:41:57.186059+0000","last_undegraded":"2024-09-17T16:41:57.186059+0000","last_fullsized":"2024-09-17T16:41:57.186059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"30'2","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.130993+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:41:57.130993+0000","last_peered":"2024-09-17T16:41:57.130993+0000","last_clean":"2024-09-17T16:41:57.130993+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:41:57.130993+0000","last_undegraded":"2024-09-17T16:41:57.130993+0000","last_fullsized":"2024-09-17T16:41:57.130993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299395+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:41:58.299395+0000","last_peered":"2024-09-17T16:41:58.299395+0000","last_clean":"2024-09-17T16:41:58.299395+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:41:58.299395+0000","last_undegraded":"2024-09-17T16:41:58.299395+0000","last_fullsized":"2024-09-17T16:41:58.299395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299208+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:41:58.299208+0000","last_peered":"2024-09-17T16:41:58.299208+0000","last_clean":"2024-09-17T16:41:58.299208+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:41:58.299208+0000","last_undegraded":"2024-09-17T16:41:58.299208+0000","last_fullsized":"2024-09-17T16:41:58.299208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"28'1","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.309108+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:41:58.309108+0000","last_peered":"2024-09-17T16:41:58.309108+0000","last_clean":"2024-09-17T16:41:58.309108+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:41:58.309108+0000","last_undegraded":"2024-09-17T16:41:58.309108+0000","last_fullsized":"2024-09-17T16:41:58.309108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'92","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.308792+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:41:58.308792+0000","last_peered":"2024-09-17T16:41:58.308792+0000","last_clean":"2024-09-17T16:41:58.308792+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:41:58.308792+0000","last_undegraded":"2024-09-17T16:41:58.308792+0000","last_fullsized":"2024-09-17T16:41:58.308792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182407,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182407,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":651852,"data_compressed":16733,"data_compressed_allocated":53248,"data_compressed_original":565248,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":122924,"data_compressed":9462,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,5,6,7,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":661398,"data_compressed":17832,"data_compressed_allocated":57344,"data_compressed_original":561152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247815,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215112,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215111,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":122924,"data_compressed":9462,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:01.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:02.228 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:02.229 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:02.240 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T16:42:01.043938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":441328,"kb_used_data":4672,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509508112,"statfs":{"total":1546188226560,"available":1545736306688,"internally_reserved":0,"allocated":4784128,"data_stored":3148776,"data_compressed":190049,"data_compressed_allocated":446464,"data_compressed_original":1798144,"omap_allocated":25521,"internal_metadata":446733391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.129605+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:41:57.129605+0000","last_peered":"2024-09-17T16:41:57.129605+0000","last_clean":"2024-09-17T16:41:57.129605+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:41:57.129605+0000","last_undegraded":"2024-09-17T16:41:57.129605+0000","last_fullsized":"2024-09-17T16:41:57.129605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.095232+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:41:58.095232+0000","last_peered":"2024-09-17T16:41:58.095232+0000","last_clean":"2024-09-17T16:41:58.095232+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:41:58.095232+0000","last_undegraded":"2024-09-17T16:41:58.095232+0000","last_fullsized":"2024-09-17T16:41:58.095232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.122222+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:41:57.122222+0000","last_peered":"2024-09-17T16:41:57.122222+0000","last_clean":"2024-09-17T16:41:57.122222+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:41:57.122222+0000","last_undegraded":"2024-09-17T16:41:57.122222+0000","last_fullsized":"2024-09-17T16:41:57.122222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.186059+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:41:57.186059+0000","last_peered":"2024-09-17T16:41:57.186059+0000","last_clean":"2024-09-17T16:41:57.186059+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:41:57.186059+0000","last_undegraded":"2024-09-17T16:41:57.186059+0000","last_fullsized":"2024-09-17T16:41:57.186059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"30'2","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.130993+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:41:57.130993+0000","last_peered":"2024-09-17T16:41:57.130993+0000","last_clean":"2024-09-17T16:41:57.130993+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:41:57.130993+0000","last_undegraded":"2024-09-17T16:41:57.130993+0000","last_fullsized":"2024-09-17T16:41:57.130993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299395+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:41:58.299395+0000","last_peered":"2024-09-17T16:41:58.299395+0000","last_clean":"2024-09-17T16:41:58.299395+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:41:58.299395+0000","last_undegraded":"2024-09-17T16:41:58.299395+0000","last_fullsized":"2024-09-17T16:41:58.299395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299208+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:41:58.299208+0000","last_peered":"2024-09-17T16:41:58.299208+0000","last_clean":"2024-09-17T16:41:58.299208+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:41:58.299208+0000","last_undegraded":"2024-09-17T16:41:58.299208+0000","last_fullsized":"2024-09-17T16:41:58.299208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"28'1","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.309108+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:41:58.309108+0000","last_peered":"2024-09-17T16:41:58.309108+0000","last_clean":"2024-09-17T16:41:58.309108+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:41:58.309108+0000","last_undegraded":"2024-09-17T16:41:58.309108+0000","last_fullsized":"2024-09-17T16:41:58.309108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'92","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.308792+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:41:58.308792+0000","last_peered":"2024-09-17T16:41:58.308792+0000","last_clean":"2024-09-17T16:41:58.308792+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:41:58.308792+0000","last_undegraded":"2024-09-17T16:41:58.308792+0000","last_fullsized":"2024-09-17T16:41:58.308792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182407,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182407,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":651852,"data_compressed":16733,"data_compressed_allocated":53248,"data_compressed_original":565248,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":122924,"data_compressed":9462,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,5,6,7,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":661398,"data_compressed":17832,"data_compressed_allocated":57344,"data_compressed_original":561152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247815,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215112,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215111,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":122924,"data_compressed":9462,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:02.241 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T16:42:02.242 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T16:42:02.242 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T16:42:02.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T16:42:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:02.578 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T16:42:02.590 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T16:42:02.590 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-17T16:42:02.603 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-17T16:42:02.603 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T16:42:02.603 INFO:tasks.thrashosds:config is {'aggressive_pg_num_changes': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-17T16:42:02.603 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-17T16:42:02.603 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T16:42:02.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:02.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:02.902 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:02.915 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T16:42:01.043938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":441328,"kb_used_data":4672,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509508112,"statfs":{"total":1546188226560,"available":1545736306688,"internally_reserved":0,"allocated":4784128,"data_stored":3148776,"data_compressed":190049,"data_compressed_allocated":446464,"data_compressed_original":1798144,"omap_allocated":25521,"internal_metadata":446733391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001362"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.129605+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:41:57.129605+0000","last_peered":"2024-09-17T16:41:57.129605+0000","last_clean":"2024-09-17T16:41:57.129605+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:41:57.129605+0000","last_undegraded":"2024-09-17T16:41:57.129605+0000","last_fullsized":"2024-09-17T16:41:57.129605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.095232+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:41:58.095232+0000","last_peered":"2024-09-17T16:41:58.095232+0000","last_clean":"2024-09-17T16:41:58.095232+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:41:58.095232+0000","last_undegraded":"2024-09-17T16:41:58.095232+0000","last_fullsized":"2024-09-17T16:41:58.095232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.122222+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:41:57.122222+0000","last_peered":"2024-09-17T16:41:57.122222+0000","last_clean":"2024-09-17T16:41:57.122222+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:41:57.122222+0000","last_undegraded":"2024-09-17T16:41:57.122222+0000","last_fullsized":"2024-09-17T16:41:57.122222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.186059+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:41:57.186059+0000","last_peered":"2024-09-17T16:41:57.186059+0000","last_clean":"2024-09-17T16:41:57.186059+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:41:57.186059+0000","last_undegraded":"2024-09-17T16:41:57.186059+0000","last_fullsized":"2024-09-17T16:41:57.186059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"30'2","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.130993+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:41:57.130993+0000","last_peered":"2024-09-17T16:41:57.130993+0000","last_clean":"2024-09-17T16:41:57.130993+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:41:57.130993+0000","last_undegraded":"2024-09-17T16:41:57.130993+0000","last_fullsized":"2024-09-17T16:41:57.130993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299395+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:41:58.299395+0000","last_peered":"2024-09-17T16:41:58.299395+0000","last_clean":"2024-09-17T16:41:58.299395+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:41:58.299395+0000","last_undegraded":"2024-09-17T16:41:58.299395+0000","last_fullsized":"2024-09-17T16:41:58.299395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299208+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:41:58.299208+0000","last_peered":"2024-09-17T16:41:58.299208+0000","last_clean":"2024-09-17T16:41:58.299208+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:41:58.299208+0000","last_undegraded":"2024-09-17T16:41:58.299208+0000","last_fullsized":"2024-09-17T16:41:58.299208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"28'1","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.309108+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:41:58.309108+0000","last_peered":"2024-09-17T16:41:58.309108+0000","last_clean":"2024-09-17T16:41:58.309108+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:41:58.309108+0000","last_undegraded":"2024-09-17T16:41:58.309108+0000","last_fullsized":"2024-09-17T16:41:58.309108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'92","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.308792+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:41:58.308792+0000","last_peered":"2024-09-17T16:41:58.308792+0000","last_clean":"2024-09-17T16:41:58.308792+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:41:58.308792+0000","last_undegraded":"2024-09-17T16:41:58.308792+0000","last_fullsized":"2024-09-17T16:41:58.308792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182407,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182407,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":651852,"data_compressed":16733,"data_compressed_allocated":53248,"data_compressed_original":565248,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":122924,"data_compressed":9462,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,5,6,7,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":661398,"data_compressed":17832,"data_compressed_allocated":57344,"data_compressed_original":561152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247815,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215112,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215111,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182407,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":282624,"data_stored":122924,"data_compressed":9462,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182405,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:02.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:03.213 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:03.213 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:03.226 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T16:42:03.044458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":441364,"kb_used_data":4708,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509508076,"statfs":{"total":1546188226560,"available":1545736269824,"internally_reserved":0,"allocated":4820992,"data_stored":3177414,"data_compressed":195803,"data_compressed_allocated":458752,"data_compressed_original":1822720,"omap_allocated":25521,"internal_metadata":446733391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.932987"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.129605+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:41:57.129605+0000","last_peered":"2024-09-17T16:41:57.129605+0000","last_clean":"2024-09-17T16:41:57.129605+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:41:57.129605+0000","last_undegraded":"2024-09-17T16:41:57.129605+0000","last_fullsized":"2024-09-17T16:41:57.129605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.095232+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:41:58.095232+0000","last_peered":"2024-09-17T16:41:58.095232+0000","last_clean":"2024-09-17T16:41:58.095232+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:41:58.095232+0000","last_undegraded":"2024-09-17T16:41:58.095232+0000","last_fullsized":"2024-09-17T16:41:58.095232+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.122222+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:41:57.122222+0000","last_peered":"2024-09-17T16:41:57.122222+0000","last_clean":"2024-09-17T16:41:57.122222+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:41:57.122222+0000","last_undegraded":"2024-09-17T16:41:57.122222+0000","last_fullsized":"2024-09-17T16:41:57.122222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.186059+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:41:57.186059+0000","last_peered":"2024-09-17T16:41:57.186059+0000","last_clean":"2024-09-17T16:41:57.186059+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:41:57.186059+0000","last_undegraded":"2024-09-17T16:41:57.186059+0000","last_fullsized":"2024-09-17T16:41:57.186059+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"30'2","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:57.130993+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:41:57.130993+0000","last_peered":"2024-09-17T16:41:57.130993+0000","last_clean":"2024-09-17T16:41:57.130993+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:41:57.130993+0000","last_undegraded":"2024-09-17T16:41:57.130993+0000","last_fullsized":"2024-09-17T16:41:57.130993+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299395+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:41:58.299395+0000","last_peered":"2024-09-17T16:41:58.299395+0000","last_clean":"2024-09-17T16:41:58.299395+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:41:58.299395+0000","last_undegraded":"2024-09-17T16:41:58.299395+0000","last_fullsized":"2024-09-17T16:41:58.299395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.299208+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:41:58.299208+0000","last_peered":"2024-09-17T16:41:58.299208+0000","last_clean":"2024-09-17T16:41:58.299208+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:41:58.299208+0000","last_undegraded":"2024-09-17T16:41:58.299208+0000","last_fullsized":"2024-09-17T16:41:58.299208+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"28'1","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.309108+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:41:58.309108+0000","last_peered":"2024-09-17T16:41:58.309108+0000","last_clean":"2024-09-17T16:41:58.309108+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:41:58.309108+0000","last_undegraded":"2024-09-17T16:41:58.309108+0000","last_fullsized":"2024-09-17T16:41:58.309108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'92","reported_seq":25,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T16:41:58.308792+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:41:58.308792+0000","last_peered":"2024-09-17T16:41:58.308792+0000","last_clean":"2024-09-17T16:41:58.308792+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:41:58.308792+0000","last_undegraded":"2024-09-17T16:41:58.308792+0000","last_fullsized":"2024-09-17T16:41:58.308792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182408,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182408,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":661398,"data_compressed":18651,"data_compressed_allocated":57344,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,5,6,7,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":348160,"data_stored":661398,"data_compressed":17832,"data_compressed_allocated":57344,"data_compressed_original":561152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313223,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247815,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215112,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215111,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215111,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182406,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:03.227 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T16:42:03.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-17T16:42:03.526 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 30 2024-09-17T16:42:03.526 INFO:teuthology.orchestra.run.smithi060.stdout:fsid a18a1a02-ea8d-4573-a275-cb30a154e84c 2024-09-17T16:42:03.526 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-17T16:41:30.645147+0000 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:modified 2024-09-17T16:41:57.116002+0000 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:crush_version 6 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:full_ratio 0.95 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:backfillfull_ratio 0.9 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:nearfull_ratio 0.85 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:require_min_compat_client luminous 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:min_compat_client jewel 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:require_osd_release squid 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:stretch_mode_enabled false 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 15.38 2024-09-17T16:42:03.527 INFO:teuthology.orchestra.run.smithi060.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 30 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 3.99 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout: removed_snaps_queue [2~1] 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:max_osd 16 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/360852295,v1:172.21.15.60:6817/360852295] [v2:172.21.15.60:6818/360852295,v1:172.21.15.60:6819/360852295] exists,up c580007f-04f5-4607-bcb0-9eca9fb6a273 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/2001248690,v1:172.21.15.98:6825/2001248690] [v2:172.21.15.98:6826/2001248690,v1:172.21.15.98:6827/2001248690] exists,up 5068e4a5-399f-472d-bf4d-0105adfba800 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2 up in weight 1 up_from 22 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6808/1107977430,v1:172.21.15.111:6809/1107977430] [v2:172.21.15.111:6810/1107977430,v1:172.21.15.111:6811/1107977430] exists,up 5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6826/3360497893,v1:172.21.15.183:6827/3360497893] [v2:172.21.15.183:6828/3360497893,v1:172.21.15.183:6829/3360497893] exists,up e00f6dc3-b74d-441a-abff-55ed4fba87a1 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4 up in weight 1 up_from 22 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/3686363495,v1:172.21.15.60:6825/3686363495] [v2:172.21.15.60:6826/3686363495,v1:172.21.15.60:6827/3686363495] exists,up 7d0041d5-389e-4b11-b8e1-535c6113a4f7 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/3943188618,v1:172.21.15.98:6801/3943188618] [v2:172.21.15.98:6802/3943188618,v1:172.21.15.98:6803/3943188618] exists,up 9fc5ba03-7465-43f6-a148-fcecb32304a7 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6 up in weight 1 up_from 24 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/2604225407,v1:172.21.15.111:6801/2604225407] [v2:172.21.15.111:6802/2604225407,v1:172.21.15.111:6803/2604225407] exists,up 2f2be94b-f485-485b-9d16-80f293b0274c 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6818/462795917,v1:172.21.15.183:6819/462795917] [v2:172.21.15.183:6820/462795917,v1:172.21.15.183:6821/462795917] exists,up eedf3336-c9e3-4c8c-b81a-2f0ebfad326c 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8 up in weight 1 up_from 21 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/680830956,v1:172.21.15.60:6801/680830956] [v2:172.21.15.60:6802/680830956,v1:172.21.15.60:6803/680830956] exists,up 44e1f674-128a-4388-a488-ffdec5ab479a 2024-09-17T16:42:03.528 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9 up in weight 1 up_from 21 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/2482839491,v1:172.21.15.98:6809/2482839491] [v2:172.21.15.98:6810/2482839491,v1:172.21.15.98:6811/2482839491] exists,up c085e6d8-5929-4ab1-826e-cecb51ed73cd 2024-09-17T16:42:03.529 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6816/598689172,v1:172.21.15.111:6817/598689172] [v2:172.21.15.111:6818/598689172,v1:172.21.15.111:6819/598689172] exists,up 87248b6a-e219-48a5-911c-4995588e51a2 2024-09-17T16:42:03.529 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11 up in weight 1 up_from 25 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6802/2000091361,v1:172.21.15.183:6803/2000091361] [v2:172.21.15.183:6804/2000091361,v1:172.21.15.183:6805/2000091361] exists,up 21b3d129-c96b-4240-aaaf-682d06b10e50 2024-09-17T16:42:03.529 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/1039497225,v1:172.21.15.60:6809/1039497225] [v2:172.21.15.60:6810/1039497225,v1:172.21.15.60:6811/1039497225] exists,up 953f99d2-c3d1-4bac-b9c7-7f56bed3a05f 2024-09-17T16:42:03.529 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13 up in weight 1 up_from 22 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/2084737149,v1:172.21.15.98:6817/2084737149] [v2:172.21.15.98:6818/2084737149,v1:172.21.15.98:6819/2084737149] exists,up a4d32ef9-7344-4d6e-a16c-8cc8623b23a6 2024-09-17T16:42:03.529 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] [v2:172.21.15.111:6826/3233790125,v1:172.21.15.111:6827/3233790125] exists,up 9305c16f-a01d-4eb1-95ff-df3616720e1f 2024-09-17T16:42:03.529 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15 up in weight 1 up_from 25 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] [v2:172.21.15.183:6812/2101706733,v1:172.21.15.183:6813/2101706733] exists,up 9a0ea790-a644-426d-baa7-35a2699a2123 2024-09-17T16:42:03.539 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/360852295,v1:172.21.15.60:6817/360852295] [v2:172.21.15.60:6818/360852295,v1:172.21.15.60:6819/360852295] exists,up c580007f-04f5-4607-bcb0-9eca9fb6a273', 'osd.1 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/2001248690,v1:172.21.15.98:6825/2001248690] [v2:172.21.15.98:6826/2001248690,v1:172.21.15.98:6827/2001248690] exists,up 5068e4a5-399f-472d-bf4d-0105adfba800', 'osd.2 up in weight 1 up_from 22 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6808/1107977430,v1:172.21.15.111:6809/1107977430] [v2:172.21.15.111:6810/1107977430,v1:172.21.15.111:6811/1107977430] exists,up 5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d', 'osd.3 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6826/3360497893,v1:172.21.15.183:6827/3360497893] [v2:172.21.15.183:6828/3360497893,v1:172.21.15.183:6829/3360497893] exists,up e00f6dc3-b74d-441a-abff-55ed4fba87a1', 'osd.4 up in weight 1 up_from 22 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/3686363495,v1:172.21.15.60:6825/3686363495] [v2:172.21.15.60:6826/3686363495,v1:172.21.15.60:6827/3686363495] exists,up 7d0041d5-389e-4b11-b8e1-535c6113a4f7', 'osd.5 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/3943188618,v1:172.21.15.98:6801/3943188618] [v2:172.21.15.98:6802/3943188618,v1:172.21.15.98:6803/3943188618] exists,up 9fc5ba03-7465-43f6-a148-fcecb32304a7', 'osd.6 up in weight 1 up_from 24 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6800/2604225407,v1:172.21.15.111:6801/2604225407] [v2:172.21.15.111:6802/2604225407,v1:172.21.15.111:6803/2604225407] exists,up 2f2be94b-f485-485b-9d16-80f293b0274c', 'osd.7 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6818/462795917,v1:172.21.15.183:6819/462795917] [v2:172.21.15.183:6820/462795917,v1:172.21.15.183:6821/462795917] exists,up eedf3336-c9e3-4c8c-b81a-2f0ebfad326c', 'osd.8 up in weight 1 up_from 21 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/680830956,v1:172.21.15.60:6801/680830956] [v2:172.21.15.60:6802/680830956,v1:172.21.15.60:6803/680830956] exists,up 44e1f674-128a-4388-a488-ffdec5ab479a', 'osd.9 up in weight 1 up_from 21 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/2482839491,v1:172.21.15.98:6809/2482839491] [v2:172.21.15.98:6810/2482839491,v1:172.21.15.98:6811/2482839491] exists,up c085e6d8-5929-4ab1-826e-cecb51ed73cd', 'osd.10 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6816/598689172,v1:172.21.15.111:6817/598689172] [v2:172.21.15.111:6818/598689172,v1:172.21.15.111:6819/598689172] exists,up 87248b6a-e219-48a5-911c-4995588e51a2', 'osd.11 up in weight 1 up_from 25 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6802/2000091361,v1:172.21.15.183:6803/2000091361] [v2:172.21.15.183:6804/2000091361,v1:172.21.15.183:6805/2000091361] exists,up 21b3d129-c96b-4240-aaaf-682d06b10e50', 'osd.12 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/1039497225,v1:172.21.15.60:6809/1039497225] [v2:172.21.15.60:6810/1039497225,v1:172.21.15.60:6811/1039497225] exists,up 953f99d2-c3d1-4bac-b9c7-7f56bed3a05f', 'osd.13 up in weight 1 up_from 22 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/2084737149,v1:172.21.15.98:6817/2084737149] [v2:172.21.15.98:6818/2084737149,v1:172.21.15.98:6819/2084737149] exists,up a4d32ef9-7344-4d6e-a16c-8cc8623b23a6', 'osd.14 up in weight 1 up_from 25 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] [v2:172.21.15.111:6826/3233790125,v1:172.21.15.111:6827/3233790125] exists,up 9305c16f-a01d-4eb1-95ff-df3616720e1f', 'osd.15 up in weight 1 up_from 25 up_thru 27 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] [v2:172.21.15.183:6812/2101706733,v1:172.21.15.183:6813/2101706733] exists,up 9a0ea790-a644-426d-baa7-35a2699a2123'] 2024-09-17T16:42:03.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "mon.a", 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster": "ceph", 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "admin_socket_mode": "", 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_client_required": "cephx, none", 2024-09-17T16:42:03.641 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_cluster_required": "cephx", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_debug": "true", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_service_required": "cephx", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_supported": "cephx", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_aio": "true", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_aio_poll_ms": "250", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_aio_reap_max": "16", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_async_discard_threads": "0", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_block_size": "4096", 2024-09-17T16:42:03.642 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_debug_aio": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_debug_inflight_ios": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_enable_discard": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_flock_retry": "3", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_inject_crash": "0", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_ioring": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_ioring_hipri": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-17T16:42:03.643 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bdev_type": "", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_alloc_size": "1048576", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_allocator": "hybrid", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_buffered_io": "true", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_check_for_zeros": "false", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_compact_log_sync": "false", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-17T16:42:03.644 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_max_log_runway": "4194304", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_max_prefetch": "1048576", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_min_flush_size": "524288", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_min_log_runway": "1048576", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_replay_recovery": "false", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_sync_write": "false", 2024-09-17T16:42:03.645 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_allocation_from_file": "true", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_allocator": "hybrid", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_async_db_compaction": "true", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bdev_label_multi": "true", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-17T16:42:03.646 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_create": "true", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_db_create": "false", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_db_path": "", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_db_size": "0", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_path": "", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_preallocate_file": "false", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_size": "107374182400", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_wal_create": "false", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_wal_path": "", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_block_wal_size": "100663296", 2024-09-17T16:42:03.647 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bluefs": "true", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_autotune": "true", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-17T16:42:03.648 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_size": "0", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_type": "2q", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_clone_cow": "true", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-17T16:42:03.649 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_mode": "none", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_csum_type": "crc32c", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_freelist": "false", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-17T16:42:03.650 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_small_allocations": "0", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_default_buffered_read": "true", 2024-09-17T16:42:03.651 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_default_buffered_write": "false", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fail_eio": "false", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-17T16:42:03.652 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_on_mount": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_on_umount": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-17T16:42:03.653 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_ignore_data_csum": "false", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_log_op_age": "5.000000", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_max_alloc_size": "0", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_max_blob_size": "0", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-17T16:42:03.654 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_max_deferred_txc": "32", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_min_alloc_size": "0", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_nid_prealloc": "1024", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_retry_disk_reads": "3", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_rocksdb_cf": "true", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-17T16:42:03.655 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_spdk_mem": "512", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-17T16:42:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_tracing": "false", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_write_v2": "false", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_write_v2_random": "false", 2024-09-17T16:42:03.657 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_zero_block_detection": "false", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-17T16:42:03.658 INFO:teuthology.orchestra.run.smithi060.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_cluster_require_signatures": "false", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_cluster_require_version": "2", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_require_signatures": "false", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_require_version": "2", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_service_require_signatures": "false", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_service_require_version": "2", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "cephx_sign_messages": "true", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "chdir": "", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "client_acl_type": "", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "client_asio_thread_count": "2", 2024-09-17T16:42:03.659 INFO:teuthology.orchestra.run.smithi060.stdout: "client_cache_mid": "0.750000", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_cache_size": "16384", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_caps_release_delay": "5", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_check_pool_perm": "true", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_debug_force_sync_read": "false", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_debug_getattr_caps": "false", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_debug_inject_features": "", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_debug_inject_tick_delay": "0", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_die_on_failed_remount": "false", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_dirsize_rbytes": "true", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_force_lazyio": "false", 2024-09-17T16:42:03.660 INFO:teuthology.orchestra.run.smithi060.stdout: "client_fs": "", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_inject_release_failure": "false", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_max_inline_size": "4096", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_mds_namespace": "", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_metadata": "", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_mount_gid": "-1", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_mount_timeout": "300", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_mount_uid": "-1", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_mountpoint": "/", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_notify_timeout": "10", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_oc": "true", 2024-09-17T16:42:03.661 INFO:teuthology.orchestra.run.smithi060.stdout: "client_oc_max_dirty": "104857600", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_oc_max_objects": "1000", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_oc_size": "209715200", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_oc_target_dirty": "8388608", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_permissions": "true", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_quota": "true", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_quota_df": "true", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_readahead_max_bytes": "0", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_readahead_max_periods": "4", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_readahead_min": "131072", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_reconnect_stale": "false", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_shutdown_timeout": "30", 2024-09-17T16:42:03.662 INFO:teuthology.orchestra.run.smithi060.stdout: "client_snapdir": ".snap", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "client_tick_interval": "1", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "client_trace": "", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "client_try_dentry_invalidate": "false", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "client_use_faked_inos": "false", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "client_use_random_mds": "false", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_graylog": "false", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_graylog_port": "12201", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_monitors": "default=true", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_syslog": "false", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-17T16:42:03.663 INFO:teuthology.orchestra.run.smithi060.stdout: "clog_to_syslog_level": "info", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "-", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_network": "", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_network_interface": "", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "compressor_zlib_isal": "false", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "compressor_zlib_level": "5", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "compressor_zlib_winsize": "-15", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "compressor_zstd_level": "1", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_alien_op_num_threads": "6", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-17T16:42:03.664 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_osd_stat_interval": "0", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_seastar_cpu_cores": "", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crimson_seastar_num_threads": "0", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location": "", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location_hook": "", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_location_hook_timeout": "10", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "daemonize": "false", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "daos_pool": "tank", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-17T16:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_alienstore": "0/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_allow_any_pool_priority": "false", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_asok": "1/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_asok_assert_abort": "false", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_asserts_on_shutdown": "true", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_auth": "20/20", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_bdev": "1/3", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_bluefs": "1/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_bluestore": "1/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_buffer": "0/1", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_ceph_dedup": "0/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_ceph_exporter": "1/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_cephfs_mirror": "0/5", 2024-09-17T16:42:03.666 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_cephsqlite": "0/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_client": "0/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_compressor": "1/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_context": "0/1", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_crimson_interrupt": "0/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_crush": "1/1", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_crypto": "1/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_cyanstore": "0/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_deliberately_leak_memory": "false", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_disable_randomized_ping": "false", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_dpdk": "1/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_eventtrace": "1/5", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_filer": "0/1", 2024-09-17T16:42:03.667 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_filestore": "1/3", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_finisher": "1/1", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_fuse": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_heartbeat_testing_span": "0", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_heartbeatmap": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_javaclient": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_journal": "1/3", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_journaler": "0/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_kstore": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_lockdep": "0/1", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mclock": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds_balancer": "1/5", 2024-09-17T16:42:03.668 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds_locker": "1/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds_log": "1/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds_log_expire": "1/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds_migrator": "1/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mds_quiesce": "3/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_memstore": "1/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mgr": "2/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mgrc": "1/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_mon": "20/20", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_monc": "0/10", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_ms": "1/1", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_none": "0/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_objclass": "0/5", 2024-09-17T16:42:03.669 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_objectcacher": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_objecter": "0/1", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_optracker": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_osd": "1/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_paxos": "20/20", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_perfcounter": "1/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_prioritycache": "1/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rados": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rbd": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rbd_mirror": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rbd_pwl": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rbd_replay": "0/5", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_refs": "0/0", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_reserver": "1/1", 2024-09-17T16:42:03.670 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_access": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_datacache": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_dbstore": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_flight": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_notification": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rgw_sync": "1/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_rocksdb": "4/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore": "0/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_backref": "0/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_cache": "0/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_cleaner": "0/5", 2024-09-17T16:42:03.671 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_device": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_epm": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_journal": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_lba": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_odata": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_omap": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_onode": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_t": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_seastore_tm": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_striper": "0/1", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_test": "0/5", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_throttle": "1/1", 2024-09-17T16:42:03.672 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_timer": "0/1", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_tp": "0/5", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "debug_trace": "1/5", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "device_failure_prediction_mode": "none", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "err_to_graylog": "false", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "err_to_journald": "false", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "err_to_stderr": "true", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "err_to_syslog": "false", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event_tracing": "false", 2024-09-17T16:42:03.673 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_addr": "0.0.0.0", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_cert_file": "", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_http_port": "9926", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_key_file": "", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_prio_limit": "5", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_sort_metrics": "true", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "exporter_stats_period": "5", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "fake_statfs_for_testing": "0", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "fatal_signal_handlers": "true", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "filer_max_purge_ops": "10", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "filer_max_truncate_ops": "128", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_apply_finisher_threads": "1", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_blackhole": "false", 2024-09-17T16:42:03.674 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_btrfs_clone_range": "true", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_btrfs_snap": "true", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_caller_concurrency": "10", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_collect_device_partition_information": "true", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_commit_timeout": "600.000000", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_debug_inject_read_err": "false", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_debug_omap_check": "false", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_debug_verify_split": "false", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_dump_file": "", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fadvise": "true", 2024-09-17T16:42:03.675 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fail_eio": "true", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fd_cache_shards": "16", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fd_cache_size": "128", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fiemap": "false", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fiemap_threshold": "4096", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_inject_stall": "0", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_journal_parallel": "false", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_journal_trailing": "false", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_journal_writeahead": "false", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_kill_at": "0", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-17T16:42:03.676 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattrs": "0", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_xattr_value_size": "0", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_merge_threshold": "-10", 2024-09-17T16:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_odsync_write": "false", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_omap_backend": "rocksdb", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_omap_backend_path": "", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_op_thread_timeout": "60", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_op_threads": "2", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_punch_hole": "false", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-17T16:42:03.678 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_queue_max_ops": "50", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_seek_data_hole": "false", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_sloppy_crc": "false", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_splice": "false", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_split_multiple": "2", 2024-09-17T16:42:03.679 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_split_rand_factor": "20", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_update_to": "1000", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_enable": "true", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-17T16:42:03.680 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_xfs_extsize": "false", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "filestore_zfs_snap": "false", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fio_dir": "/tmp/fio", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "a18a1a02-ea8d-4573-a275-cb30a154e84c", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_allow_other": "true", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_atomic_o_trunc": "true", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_big_writes": "true", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_debug": "false", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_default_permissions": "false", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_disable_pagecache": "false", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_max_write": "0", 2024-09-17T16:42:03.681 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_multithreaded": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_require_active_mds": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_set_user_groups": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_splice_move": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_splice_read": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_splice_write": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "fuse_use_invalidate_cb": "true", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "gss_target_name": "ceph", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_file": "", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_inject_failure": "0", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_interval": "5", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "host": "smithi060", 2024-09-17T16:42:03.682 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-17T16:42:03.683 INFO:teuthology.orchestra.run.smithi060.stdout: "inject_early_sigterm": "false", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "jaeger_agent_port": "6799", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "jaeger_tracing_enable": "false", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_aio": "true", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_align_min_size": "65536", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_block_align": "true", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_block_size": "4096", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_dio": "true", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_discard": "false", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_force_aio": "false", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_ignore_corruption": "false", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_max_write_bytes": "10485760", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_max_write_entries": "100", 2024-09-17T16:42:03.684 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_replay_from": "0", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_write_header_frequency": "0", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journal_zero_on_create": "false", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journaler_prefetch_periods": "10", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journaler_prezero_periods": "5", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "journaler_write_head_interval": "15", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "keyfile": "", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_backend": "rocksdb", 2024-09-17T16:42:03.685 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_default_stripe_size": "65536", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_fsck_on_mount": "false", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_max_bytes": "67108864", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_max_ops": "512", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_nid_prealloc": "1024", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_onode_map_size": "1024", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_sync_submit_transaction": "false", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "kstore_sync_transaction": "false", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "librados_thread_count": "2", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "lockdep": "false", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "lockdep_force_backtrace": "false", 2024-09-17T16:42:03.686 INFO:teuthology.orchestra.run.smithi060.stdout: "log_coarse_timestamps": "true", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_flush_on_exit": "false", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_graylog_host": "127.0.0.1", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_graylog_port": "12201", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_max_new": "1000", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_max_recent": "10000", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_stderr_prefix": "", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_stop_at_utilization": "0.970000", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_file": "true", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_graylog": "false", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_journald": "false", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_stderr": "false", 2024-09-17T16:42:03.687 INFO:teuthology.orchestra.run.smithi060.stdout: "log_to_syslog": "false", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "max_rotating_auth_attempts": "10", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_action_on_write_error": "1", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_alternate_name_max": "8192", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_asio_thread_count": "2", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_export_pin": "true", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_fragment_dirs": "true", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_fragment_interval": "5", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_interval": "10", 2024-09-17T16:42:03.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_max": "-1", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_max_until": "-1", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_merge_size": "50", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_midchunk": "0.300000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_min_start": "0.200000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_minchunk": "0.001000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_mode": "0", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_need_max": "1.200000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_need_min": "0.800000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_overload_epochs": "2", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_split_bits": "3", 2024-09-17T16:42:03.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_split_size": "10000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_target_decay": "10.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_beacon_grace": "15.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_beacon_interval": "4.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_mid": "0.700000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_quiesce_delay": "0", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-17T16:42:03.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_release_free_interval": "10", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_reservation": "0.050000", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_trim_interval": "1", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache_trim_threshold": "262144", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_client_prealloc_inos": "1000", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_connect_bootstrapping": "false", 2024-09-17T16:42:03.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_damage_table_max_entries": "10000", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_debug_auth_pins": "false", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_debug_frag": "false", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_debug_scatterstat": "false", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_debug_subtrees": "false", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_decay_halflife": "5.000000", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_default_dir_hash": "2", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_defer_session_stale": "true", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_deny_all_reconnect": "false", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dir_keys_per_op": "16384", 2024-09-17T16:42:03.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dir_max_commit_size": "10", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dir_max_entries": "0", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dir_prefetch": "true", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dump_cache_on_map": "false", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_early_reply": "true", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_enable_op_tracker": "true", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_enforce_unique_name": "true", 2024-09-17T16:42:03.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_export_ephemeral_random": "true", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_health_summarize_threshold": "10", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-17T16:42:03.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_inject_health_dummy": "false", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_inject_migrator_session_race": "false", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_join_fs": "", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_journal_format": "1", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_create_at": "0", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_dirfrag_at": "0", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_export_at": "0", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_import_at": "0", 2024-09-17T16:42:03.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_journal_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_journal_expire_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_journal_replay_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_link_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_mdstable_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_openc_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_rename_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_kill_shutdown_at": "0", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_event_large_threshold": "524288", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_events_per_segment": "1024", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_max_events": "-1", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_max_segments": "128", 2024-09-17T16:42:03.696 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_pause": "false", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_segment_size": "0", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_trim_threshold": "128", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log_warn_factor": "2.000000", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_caps_per_client": "1048576", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_completed_flushes": "100000", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_completed_requests": "100000", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_export_size": "20971520", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_file_recover": "32", 2024-09-17T16:42:03.697 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_purge_files": "64", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_purge_ops": "8192", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_max_snaps_per_dir": "100", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_metrics_update_interval": "2", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_min_caps_per_client": "100", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_min_caps_working_set": "10000", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_numa_node": "-1", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_op_complaint_time": "30.000000", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_op_history_duration": "600", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_op_history_size": "20", 2024-09-17T16:42:03.698 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_op_history_slow_op_size": "20", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_op_log_threshold": "5", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_ping_grace": "15", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_ping_interval": "5", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_recall_max_caps": "30000", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_recall_warning_threshold": "262144", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-17T16:42:03.699 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_replay_interval": "1.000000", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_root_ino_gid": "0", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_root_ino_uid": "0", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_scrub_stats_review_period": "1", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-17T16:42:03.700 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_shutdown_check": "0", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_skip_ino": "0", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_snap_max_uid": "4294967294", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_snap_min_uid": "0", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_snap_rstat": "false", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_standby_replay_damaged": "false", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_symlink_recovery": "true", 2024-09-17T16:42:03.701 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_thrash_exports": "0", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_thrash_fragments": "0", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_tick_interval": "5.000000", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_valgrind_exit": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_verify_backtrace": "1", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_verify_scatter": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_wipe_sessions": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool_debug": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "memstore_device_bytes": "1073741824", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "memstore_page_set": "false", 2024-09-17T16:42:03.702 INFO:teuthology.orchestra.run.smithi060.stdout: "memstore_page_size": "65536", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_client_bytes": "134217728", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_client_messages": "512", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_disabled_modules": "", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_enable_op_tracker": "true", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_max_pg_creating": "1024", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_max_pg_num_change": "128", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_mds_bytes": "134217728", 2024-09-17T16:42:03.703 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_mds_messages": "128", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_mon_bytes": "134217728", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_mon_messages": "128", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_op_history_duration": "600", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_op_history_size": "20", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_op_log_threshold": "5", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_osd_bytes": "536870912", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_osd_messages": "8192", 2024-09-17T16:42:03.704 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_pool": "true", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_standby_modules": "true", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_stats_period": "5", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_stats_threshold": "5", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_tick_period": "2", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_allow_pool_delete": "true", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_allow_pool_size_one": "true", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_auth_validate_all_caps": "true", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-17T16:42:03.705 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_bytes": "104857600", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_directed_command_retry": "5", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_hunt_parallel": "3", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_log_interval": "1.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_ping_interval": "10.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_client_target_rank": "-1", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-17T16:42:03.706 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_level": "debug", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_file": "true", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_journald": "false", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_compact_on_bootstrap": "false", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_compact_on_start": "false", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_compact_on_trim": "true", 2024-09-17T16:42:03.707 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_cpu_threads": "4", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_crush_min_required_version": "hammer", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_daemon_bytes": "419430400", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_data_avail_crit": "5", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_data_avail_warn": "5", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_data_size_warn": "16106127360", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-17T16:42:03.708 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_dump_json": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_dump_transactions": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_extra_checks": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_no_require_reef": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_no_require_squid": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_down_mkfs_grace": "120", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_down_uptime_grace": "60", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_election_default_strategy": "1", 2024-09-17T16:42:03.709 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_election_timeout": "5.000000", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_elector_ping_divisor": "2", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_enable_op_tracker": "true", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_fake_pool_delete": "false", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_force_quorum_join": "false", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_globalid_prealloc": "10000", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_health_detail_to_clog": "false", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_health_log_update_period": "5", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_health_max_detail": "50", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_health_to_clog": "true", 2024-09-17T16:42:03.710 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_health_to_clog_interval": "600", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_host": "172.21.15.60,172.21.15.98,172.21.15.111", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_host_override": "", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_initial_members": "", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_lease": "5.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-17T16:42:03.711 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_log_full_interval": "50", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_log_max": "10000", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_log_max_summary": "50", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_log_epochs": "500", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_osd": "10000", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_pg_per_osd": "10000", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_pool_pg_num": "65536", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mds_force_trim_to": "0", 2024-09-17T16:42:03.712 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mds_skip_sanity": "false", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_memory_autotune": "true", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_memory_target": "2147483648", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mgr_beacon_grace": "30", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mgr_digest_period": "5", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mgr_inactive_grace": "60", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_min_osdmap_epochs": "500", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_op_complaint_time": "30", 2024-09-17T16:42:03.713 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_op_history_duration": "600", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_op_history_size": "20", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_op_history_slow_op_size": "20", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_op_log_threshold": "5", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_auto_mark_in": "false", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_cache_size": "500", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-17T16:42:03.714 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_down_out_interval": "600", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_force_trim_to": "0", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-17T16:42:03.715 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_min_down_reporters": "2", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_report_timeout": "900", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-17T16:42:03.716 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pg_stuck_threshold": "60", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_probe_timeout": "2.000000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_reweight_max_change": "0.050000", 2024-09-17T16:42:03.717 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_reweight_max_osds": "4", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_scrub_interval": "300", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_scrub_max_keys": "100", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_scrub_timeout": "300", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_session_timeout": "300", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_smart_report_timeout": "5", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_stat_smooth_intervals": "6", 2024-09-17T16:42:03.718 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_stretch_pool_min_size": "2", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_stretch_pool_size": "4", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_sync_debug": "false", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_sync_provider_kill_at": "0", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_sync_requester_kill_at": "0", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_sync_timeout": "60.000000", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_target_pg_per_osd": "100", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_tick_interval": "5", 2024-09-17T16:42:03.719 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_timecheck_interval": "300.000000", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_use_min_delay_socket": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_older_version_delay": "604800", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_misplaced": "false", 2024-09-17T16:42:03.720 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_older_version": "true", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "monmap": "", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T16:42:03.721 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "motr_tracing_enabled": "false", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_op_threads": "3", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_cm": "false", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_device_name": "", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_dscp": "96", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-17T16:42:03.722 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_local_gid": "", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_port_num": "1", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_sl": "3", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_support_srq": "true", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_rdma_type": "ib", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_async_reap_threshold": "5", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_before_connect": "false", 2024-09-17T16:42:03.723 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_ipv4": "true", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_ipv6": "false", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_msgr1": "true", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_msgr2": "true", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_port_max": "7568", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_port_min": "6800", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_retry_count": "3", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_bind_retry_delay": "5", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_blackhole_client": "false", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_blackhole_mds": "false", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_blackhole_mgr": "false", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_blackhole_mon": "false", 2024-09-17T16:42:03.724 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_blackhole_osd": "false", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_client_mode": "crc secure", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_cluster_mode": "crc secure", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_cluster_type": "", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_compress_secure": "false", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_connection_idle_timeout": "900", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_connection_ready_timeout": "10", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_crc_data": "true", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_crc_header": "true", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_die_on_bad_msg": "false", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_die_on_bug": "true", 2024-09-17T16:42:03.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_die_on_old_message": "true", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_die_on_skipped_message": "false", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_coremask": "0xF", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_enable_tso": "true", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_hugepages": "", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-17T16:42:03.726 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_lro": "true", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_memory_channel": "4", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_pmd": "", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_port_id": "0", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_dump_on_send": "false", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_initial_backoff": "0.200000", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_inject_delay_max": "1.000000", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_inject_delay_type": "", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-17T16:42:03.727 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_inject_network_congestion": "0", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_inject_socket_failures": "2500", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_learn_addr_from_peer": "true", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_max_accept_failures": "4", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_max_backoff": "15.000000", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_mon_client_mode": "secure crc", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_mon_service_mode": "secure crc", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_osd_compress_min_size": "1024", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_osd_compress_mode": "none", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-17T16:42:03.728 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_pq_min_cost": "65536", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_public_type": "", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_service_mode": "crc secure", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_tcp_listen_backlog": "512", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_tcp_nodelay": "true", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_tcp_rcvbuf": "0", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "ms_type": "async+posix", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "no_config_file": "false", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_completion_locks_per_session": "32", 2024-09-17T16:42:03.729 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_inflight_ops": "1024", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_tick_interval": "5.000000", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter_timeout": "10.000000", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objectstore_blackhole": "false", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "openssl_engine_opts": "", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_delay_time": "5.000000", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_hist_halflife": "1000", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_max_low_ops": "2", 2024-09-17T16:42:03.730 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_max_ops": "4", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_agent_slop": "0.020000", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_asio_thread_count": "2", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_async_recovery_min_cost": "100", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_backfill_scan_max": "512", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_backfill_scan_min": "64", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_backoff_on_degraded": "false", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_backoff_on_peering": "false", 2024-09-17T16:42:03.731 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_backoff_on_unfound": "true", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_beacon_report_interval": "300", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bench_duration": "30", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bench_max_block_size": "67108864", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_blkin_trace_all": "false", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_check_for_log_corruption": "false", 2024-09-17T16:42:03.732 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_class_update_on_start": "true", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_client_message_cap": "256", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_client_message_size_cap": "524288000", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_client_op_priority": "63", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_client_watch_timeout": "30", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_command_max_records": "256", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_compact_on_start": "false", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-17T16:42:03.733 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_crush_update_on_start": "true", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_crush_update_weight_set": "true", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_feed_pullee": "-1", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-17T16:42:03.734 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_misdirected_ops": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_no_acting_change": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_no_purge_strays": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_op_order": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_shutdown": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_trim_objects": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-17T16:42:03.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_verify_snaps": "false", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_keys": "1024", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_stride": "524288", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_default_notify_timeout": "30", 2024-09-17T16:42:03.736 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_delete_sleep": "0.000000", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_discard_disconnected_ops": "true", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_ec_partial_reads": "true", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_enable_op_tracker": "true", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_fast_info": "true", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_fast_shutdown": "true", 2024-09-17T16:42:03.737 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_function_tracing": "false", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_grace": "20", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_interval": "6", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_min_peers": "10", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_min_size": "2000", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_stale": "600", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-17T16:42:03.738 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_hit_set_max_size": "100000", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_hit_set_min_size": "1000", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_journal_size": "5120", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_kill_backfill_at": "0", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_map_cache_size": "50", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_map_dedup": "true", 2024-09-17T16:42:03.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_map_message_max": "40", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_map_share_max_epochs": "40", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_attr_name_len": "100", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_attr_size": "0", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_backfills": "1", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_markdown_count": "5", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_markdown_period": "600", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_object_name_len": "2048", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_object_namespace_len": "256", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_object_size": "134217728", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-17T16:42:03.740 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_pg_blocked_by": "16", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_pg_log_entries": "10000", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_pgls": "1024", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_push_cost": "8388608", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_push_objects": "10", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_scrubs": "3", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_trimming_pgs": "2", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_write_op_reply_len": "64", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_max_write_size": "90", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-17T16:42:03.741 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_profile": "balanced", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-17T16:42:03.742 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_base": "805306368", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_cache_min": "134217728", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_target": "4294967296", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_target_autotune": "false", 2024-09-17T16:42:03.743 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_min_pg_log_entries": "250", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_min_recovery_priority": "0", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mon_report_interval": "5", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_num_cache_shards": "32", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_num_op_tracker_shard": "32", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_numa_auto_affinity": "true", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_numa_node": "-1", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_numa_prefer_iface": "true", 2024-09-17T16:42:03.744 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_objecter_finishers": "1", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_objectstore": "bluestore", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_objectstore_fuse": "false", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_objectstore_tracing": "false", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_complaint_time": "30.000000", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_history_duration": "600", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_history_size": "20", 2024-09-17T16:42:03.745 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_history_slow_op_size": "20", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_log_threshold": "5", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_num_shards": "0", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_num_shards_hdd": "5", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_num_shards_ssd": "8", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_pq_min_cost": "65536", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_queue_cut_off": "high", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-17T16:42:03.746 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_op_thread_timeout": "15", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_open_classes_on_start": "true", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_os_flags": "0", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_peering_op_priority": "255", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_delete_cost": "1048576", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_delete_priority": "5", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_log_trim_max": "10000", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_log_trim_min": "100", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-17T16:42:03.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_crimson": "false", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-17T16:42:03.748 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_flags": "0", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_min_size": "0", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_pg_num": "32", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_pgp_num": "0", 2024-09-17T16:42:03.749 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_read_ratio": "70", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_size": "2", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_default_type": "replicated", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_push_per_object_cost": "1000", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recover_clone_overlap": "true", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_cost": "20971520", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_max_active": "10", 2024-09-17T16:42:03.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_max_single_start": "10", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_op_priority": "3", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_priority": "5", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_sleep": "0.000000", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_repair_during_recovery": "false", 2024-09-17T16:42:03.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_requested_scrub_priority": "120", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_auto_repair": "false", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_begin_hour": "0", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_begin_week_day": "0", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_chunk_max": "15", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_chunk_min": "5", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_cost": "52428800", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_during_recovery": "false", 2024-09-17T16:42:03.752 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_end_hour": "0", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_end_week_day": "0", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_event_cost": "4096", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_invalid_stats": "true", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_max_preemptions": "5", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_priority": "5", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_retry_delay": "30", 2024-09-17T16:42:03.753 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_retry_trimming": "10", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_scrub_sleep": "0.000000", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_skip_data_digest": "false", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_smart_report_timeout": "5", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_snap_trim_cost": "1048576", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_snap_trim_priority": "5", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-17T16:42:03.754 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_target_transaction_size": "30", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-17T16:42:03.755 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_tracing": "false", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_use_stale_snap": "false", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "osdc_blkin_trace_all": "false", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_kill_at": "0", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_max_join_drift": "10", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_min": "500", 2024-09-17T16:42:03.756 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_min_wait": "0.050000", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_propose_interval": "1.000000", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_service_trim_max": "500", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_service_trim_min": "250", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_stash_full_interval": "25", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_trim_max": "500", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "paxos_trim_min": "250", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "perf": "true", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "-", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrv": "", 2024-09-17T16:42:03.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_bind_addr": "-", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "public_network": "", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "public_network_interface": "", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "qat_compressor_busy_polling": "false", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "qat_compressor_enabled": "false", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "qat_compressor_session_max_number": "256", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rados_mon_op_timeout": "0", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rados_osd_op_timeout": "0", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rados_tracing": "false", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_atime_update_interval": "60", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_balance_parent_reads": "false", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_balance_snap_reads": "false", 2024-09-17T16:42:03.758 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_blkin_trace_all": "false", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache": "true", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_policy": "writearound", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_size": "33554432", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_clone_copy_on_read": "false", 2024-09-17T16:42:03.759 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_compression_hint": "none", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_concurrent_management_ops": "10", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_clone_format": "auto", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_data_pool": "", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_features": "61", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_format": "2", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_map_options": "", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_order": "22", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_pool": "rbd", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_stripe_count": "0", 2024-09-17T16:42:03.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_default_stripe_unit": "0", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_enable_alloc_hint": "true", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_io_scheduler": "simple", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-17T16:42:03.761 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_order": "24", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_pool": "", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_journal_splay_width": "4", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_localize_parent_reads": "false", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_localize_snap_reads": "false", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-17T16:42:03.762 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-17T16:42:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-17T16:42:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_mtime_update_interval": "60", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_non_blocking_aio": "true", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_op_thread_timeout": "60", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_op_threads": "1", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_parent_cache_enabled": "false", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_plugins": "", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_bps_burst": "0", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_bps_limit": "0", 2024-09-17T16:42:03.765 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_exclude_ops": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_iops_burst": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_iops_limit": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-17T16:42:03.766 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_read_from_replica_policy": "default", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_skip_partial_discard": "true", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-17T16:42:03.767 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_tracing": "false", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_validate_names": "true", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd_validate_pool": "true", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "restapi_base_url": "", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "restapi_log_level": "", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_acl_grants_max_num": "100", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_admin_entry": "admin", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_asio_assert_yielding": "false", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_backend_store": "rados", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_barbican_url": "", 2024-09-17T16:42:03.768 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_beast_enable_async": "true", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_counters_cache": "false", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_cache_enabled": "true", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_cache_expiry_interval": "900", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_cache_lru_size": "25000", 2024-09-17T16:42:03.769 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_config_store": "rados", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_content_length_compat": "false", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_copy_obj_progress": "true", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_cors_rules_max_num": "100", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_cross_domain_policy": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_addr": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-17T16:42:03.770 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_password": "", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_kmip_username": "", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_require_ssl": "true", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-17T16:42:03.771 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_addr": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_auth": "token", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_namespace": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_prefix": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-17T16:42:03.772 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_token_file": "", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_curl_buffersize": "524288", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_curl_low_speed_time": "300", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-17T16:42:03.773 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_log_changes_size": "1000", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_log_num_shards": "128", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-17T16:42:03.774 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_log_window": "30", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-17T16:42:03.775 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_disable_s3select": "false", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-17T16:42:03.776 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dns_name": "", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dns_s3website_name": "", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dynamic_resharding": "true", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_gc_threads": "true", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_lc_threads": "true", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_mdsearch": "true", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_ops_log": "false", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_quota_threads": "true", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_static_website": "false", 2024-09-17T16:42:03.777 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enable_usage_log": "false", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_enforce_swift_acls": "true", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_exit_timeout_secs": "120", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_expose_bucket": "false", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_extended_http_attrs": "", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_filter": "none", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_frontends": "beast port=7480", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_max_deferred": "50", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_max_objs": "32", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-17T16:42:03.778 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_gc_processor_period": "3600", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_init_timeout": "300", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_kafka_connection_idle": "300", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-17T16:42:03.779 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_domain": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_password": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_password_path": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_project": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_tenant": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_token": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_token_path": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_admin_user": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_barbican_domain": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_barbican_password": "", 2024-09-17T16:42:03.780 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_barbican_project": "", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_barbican_user": "", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_url": "", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_debug_interval": "-1", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_lock_max_time": "90", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_max_objs": "32", 2024-09-17T16:42:03.781 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_max_rules": "1000", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_max_worker": "3", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lc_thread_delay": "0", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ldap_dnattr": "uid", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ldap_searchfilter": "", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ldap_uri": "", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-17T16:42:03.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_log_http_headers": "", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_log_object_name_utc": "false", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_attr_name_len": "0", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_attr_size": "0", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_chunk_size": "4194304", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_listing_results": "5000", 2024-09-17T16:42:03.783 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_notify_retries": "10", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_put_param_size": "1048576", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_put_size": "5368709120", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_max_slo_entries": "1000", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_md_log_max_shards": "64", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_mp_lock_max_time": "600", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-17T16:42:03.784 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_max_gc": "300", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_num_async_rados_threads": "32", 2024-09-17T16:42:03.785 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_num_control_oids": "8", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_numa_node": "-1", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_objexp_chunk_size": "100", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_objexp_gc_interval": "600", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_op_thread_timeout": "600", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_op_tracing": "false", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_opa_token": "", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_opa_url": "", 2024-09-17T16:42:03.786 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_opa_verify_ssl": "true", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ops_log_rados": "false", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_ops_log_socket_path": "", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_period_push_interval": "2.000000", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-17T16:42:03.787 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_posix_cache_lanes": "3", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_posix_cache_partitions": "3", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_print_continue": "true", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_rados_tracing": "false", 2024-09-17T16:42:03.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_realm": "", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_realm_id": "", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_region": "", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_request_uri": "", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_batch_size": "64", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_max_aio": "128", 2024-09-17T16:42:03.789 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_num_logs": "16", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshard_thread_interval": "600", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_resolve_cname": "false", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_run_sync_thread": "true", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-17T16:42:03.790 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_scheduler_type": "throttler", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_script_uri": "", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_service_provider_name": "", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_client_id": "", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_client_secret": "", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_entry": "sts", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_key": "sts", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-17T16:42:03.791 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_min_session_duration": "900", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sts_token_introspection_url": "", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_account_in_url": "false", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_auth_entry": "auth", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_auth_url": "", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_custom_header": "", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_need_stats": "true", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_tenant_name": "", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_token_expiration": "86400", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_url": "", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_url_prefix": "swift", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-17T16:42:03.792 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_lease_period": "120", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-17T16:42:03.793 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_thread_pool_size": "512", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_comment": "", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_createby": "", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_encoding": "", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_flag": "false", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-17T16:42:03.794 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_origin": "", 2024-09-17T16:42:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-17T16:42:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_torrent_tracker": "", 2024-09-17T16:42:03.795 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_trust_forwarded_https": "false", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_usage_max_shards": "32", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_usage_max_user_shards": "1", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_use_opa_authz": "false", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_counters_cache": "false", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_max_buckets": "1000", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_policies_max_num": "100", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-17T16:42:03.796 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_user_unique_email": "true", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_verify_ssl": "true", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_zone": "", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_zone_id": "", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_zonegroup": "", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_zonegroup_id": "", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgwlc_auto_session_clear": "true", 2024-09-17T16:42:03.797 INFO:teuthology.orchestra.run.smithi060.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_block_size": "4096", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cache_size": "536870912", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-17T16:42:03.798 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_index_type": "binary_search", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_partition_filters": "false", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_perf": "false", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "run_dir": "/var/run/ceph", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_block_create": "true", 2024-09-17T16:42:03.799 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_cache_lru_size": "67108864", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_default_max_object_size": "16777216", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_device_size": "53687091200", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_full_integrity_check": "false", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_journal_batch_capacity": "16", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_main_device_type": "SSD", 2024-09-17T16:42:03.800 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "seastore_segment_size": "67108864", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "set_keepcaps": "false", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "setgroup": "", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "setuser": "", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "setuser_match_path": "", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "thp": "false", 2024-09-17T16:42:03.801 INFO:teuthology.orchestra.run.smithi060.stdout: "threadpool_default_timeout": "60", 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "throttler_perf_counter": "true", 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "tmp_dir": "/tmp", 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "uadk_compressor_enabled": "false", 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-17T16:42:03.802 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:03.804 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-17T16:42:03.922 INFO:teuthology.orchestra.run.smithi060.stdout:mon.a: {} 2024-09-17T16:42:03.923 INFO:teuthology.orchestra.run.smithi060.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T16:42:03.932 INFO:teuthology.orchestra.run.smithi060.stdout:mon.b: {} 2024-09-17T16:42:03.932 INFO:teuthology.orchestra.run.smithi060.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T16:42:03.942 INFO:teuthology.orchestra.run.smithi060.stdout:mon.c: {} 2024-09-17T16:42:03.942 INFO:teuthology.orchestra.run.smithi060.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T16:42:03.952 DEBUG:teuthology.orchestra.run.smithi098:> type ceph-objectstore-tool 2024-09-17T16:42:03.971 INFO:teuthology.orchestra.run.smithi098.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T16:42:03.971 DEBUG:teuthology.orchestra.run.smithi183:> type ceph-objectstore-tool 2024-09-17T16:42:03.989 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T16:42:03.989 DEBUG:teuthology.orchestra.run.smithi111:> type ceph-objectstore-tool 2024-09-17T16:42:04.007 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T16:42:04.007 DEBUG:teuthology.orchestra.run.smithi060:> type ceph-objectstore-tool 2024-09-17T16:42:04.023 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T16:42:04.023 INFO:teuthology.run_tasks:Running task rados... 2024-09-17T16:42:04.035 INFO:tasks.rados:Beginning rados... 2024-09-17T16:42:04.035 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False} 2024-09-17T16:42:04.035 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-bharath10-testing-2024-09-17-1348'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5, 'osd_recovery_max_active': 10, 'osd_recovery_max_single_start': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': False, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath10-testing-2024-09-17-1348', 'sha1': '1889a165b5128787ec693450a3d1c5df5d6dc203'}} 2024-09-17T16:42:04.035 INFO:tasks.rados:config is {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False} 2024-09-17T16:42:04.035 DEBUG:teuthology.run_tasks:Unwinding manager rados 2024-09-17T16:42:04.051 INFO:tasks.rados:joining rados 2024-09-17T16:42:04.051 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-17T16:42:04.051 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:04.051 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:04.052 INFO:tasks.thrashosds.thrasher:inject_pause on osd.11 2024-09-17T16:42:04.052 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T16:42:04.052 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T16:42:04.052 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok config set filestore_inject_stall 3 2024-09-17T16:42:04.052 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-17T16:42:04.053 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-17T16:42:04.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:04.053 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-17T16:42:04.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:04.054 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-17T16:42:04.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:42:04.054 INFO:tasks.rados:clients are ['client.0'] 2024-09-17T16:42:04.054 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set shecprofile c=2 crush-failure-domain=osd k=4 m=3 name=shecprofile plugin=shec 2024-09-17T16:42:04.055 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:04.052+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:04.155 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:04.153+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:04.169 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:04.169 INFO:teuthology.orchestra.run.smithi183.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T16:42:04.169 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:04.178 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:04.178 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:04.178 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:04.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:04.211 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:04.211 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:04.245 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:04.246 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:04.255 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:04.254+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:04.271 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:04.289 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:04.289 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:04.307 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:04.307 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:04.321 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:04.321 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:04.324 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:04.325 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:04.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:04.342 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:04.342 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:04.356 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:04.354+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:04.359 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:04.359 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:04.378 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:04.379 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:04.395 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:04.395 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:04.413 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:04.413 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:04.430 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:04.430 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:04.446 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:04.447 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:04.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:04.446+0000 7f0802ffd640 0 -- 172.21.15.60:0/3533250066 >> [v2:172.21.15.98:6816/2084737149,v1:172.21.15.98:6817/2084737149] conn(0x7f080421e070 msgr2=0x7f0804220460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:04.451 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:04.451 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:04.457 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:04.455+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:04.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:04.465 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:04.482 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:04.500 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:04.500 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:04.558 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:04.556+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:04.573 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:04.574 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:04.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:04.659 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:04.657+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:04.689 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:04.698 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:04.760 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:04.758+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:04.845 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:04.845 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:04.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:04.860 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:04.858+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:04.961 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:04.959+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:04.962 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:04.962 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:04.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:05.062 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:05.059+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:05.078 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.078 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:load: shec 2024-09-17T16:42:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:42:05.163 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:05.161+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:05.164 INFO:tasks.rados:starting run 0 out of 1 2024-09-17T16:42:05.164 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-17T16:42:05.165 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure shecprofile 2024-09-17T16:42:05.195 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.196 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:05.263 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:05.261+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:05.355 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.355 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:05.365 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:05.362+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:05.465 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:05.462+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:05.472 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.472 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.481 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:05.566 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:05.563+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:05.589 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.590 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.599 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:05.667 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:05.665+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:05.716 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.716 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.725 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:05.769 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:05.766+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:05.829 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.829 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:05.878 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:05.875+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:05.970 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:05.968+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:05.979 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:05.979 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:05.988 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:06.071 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:06.069+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:06.091 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.091 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.099 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:06.172 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:06.170+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:06.202 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.202 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.210 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:06.273 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:06.270+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:06.312 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.313 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.321 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:06.405 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:06.402+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:06.465 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.465 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.473 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:06.475 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:06.473+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:06.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:06.576 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:06.574+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:06.616 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.616 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.625 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:06.653 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:06.653 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:06.669 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:06.676 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:06.674+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:06.687 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:06.687 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:06.704 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:06.705 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:06.721 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:06.721 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:06.728 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.728 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.736 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:06.739 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:06.739 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:06.757 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:06.757 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:06.774 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:06.774 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:06.777 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:06.775+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:06.790 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:06.791 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:06.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:06.808 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:06.825 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:06.825 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:06.840 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:06.840 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:06.842 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:06.842 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:06.849 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:06.860 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:06.876 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:06.876 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:06.877 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:06.875+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:06.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:06.889+0000 7f5644dfb640 0 -- 172.21.15.60:0/2533339906 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7f564021c300 msgr2=0x7f564021c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:06.893 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:06.894 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:06.911 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:06.952 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:06.952 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:06.952 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:06.952 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:06.952 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:06.960 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:06.978 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:06.976+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:07.063 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:07.063 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:55.137942+0000", 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.923685501, 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018044099999999999, 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:07.064 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137942+0000", 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:07.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137942+0000", 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137945+0000", 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9490000000000001e-06 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137951+0000", 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3740000000000003e-06 2024-09-17T16:42:07.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137961+0000", 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7410000000000004e-06 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137969+0000", 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0739999999999993e-06 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138018+0000", 2024-09-17T16:42:07.067 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9104999999999998e-05 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138122+0000", 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010419799999999999 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:55.138318+0000", 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.923308862000001, 2024-09-17T16:42:07.068 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114098, 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138318+0000", 2024-09-17T16:42:07.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138318+0000", 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138319+0000", 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138323+0000", 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1069999999999998e-06 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138332+0000", 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138337+0000", 2024-09-17T16:42:07.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9980000000000003e-06 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138372+0000", 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4879000000000003e-05 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138433+0000", 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1042000000000003e-05 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.072 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:56.114368+0000", 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.947258958000001, 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044041469999999997, 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:07.073 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114368+0000", 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114368+0000", 2024-09-17T16:42:07.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114370+0000", 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9690000000000001e-06 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114380+0000", 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2420000000000006e-06 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114395+0000", 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5849999999999999e-05 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114404+0000", 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6260000000000001e-06 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114465+0000", 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0698000000000001e-05 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114471+0000", 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7950000000000004e-06 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.116960+0000", 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024891510000000002 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:07.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.117071+0000", 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111024 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 12", 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.117194+0000", 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012344600000000001 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.117904+0000", 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071005799999999996 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118680+0000", 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077541399999999999 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118726+0000", 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6443999999999998e-05 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118773+0000", 2024-09-17T16:42:07.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6430000000000001e-05 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4353.0:5 2.2 e28/27 ondisk, result = 0)", 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:56.118587+0000", 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.943040395000001, 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019300799999999999, 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:07.080 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118587+0000", 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118587+0000", 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118588+0000", 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0410000000000001e-06 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118595+0000", 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9070000000000001e-06 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118609+0000", 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3821e-05 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118617+0000", 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8490000000000006e-06 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118668+0000", 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1578e-05 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118674+0000", 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7579999999999998e-06 2024-09-17T16:42:07.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118780+0000", 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106054 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.9391022170000003, 2024-09-17T16:42:07.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085139050000000004, 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122527+0000", 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.813e-06 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122536+0000", 2024-09-17T16:42:07.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5769999999999994e-06 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122551+0000", 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5962999999999999e-05 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122563+0000", 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1556000000000001e-05 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122628+0000", 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4994999999999997e-05 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122635+0000", 2024-09-17T16:42:07.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5560000000000004e-06 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129375+0000", 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067407320000000001 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129461+0000", 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5228000000000005e-05 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 12", 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129559+0000", 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8362000000000005e-05 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130320+0000", 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000760741 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130958+0000", 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063790199999999998 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130991+0000", 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3543000000000001e-05 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.131039+0000", 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7936999999999999e-05 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.091 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4353.0:7 2.2 e29/27 ondisk, result = 0)", 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:57.130882+0000", 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.9307451009999994, 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016288899999999999, 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130882+0000", 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.092 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130882+0000", 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130883+0000", 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0380000000000001e-06 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130889+0000", 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6289999999999998e-06 2024-09-17T16:42:07.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130901+0000", 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2563e-05 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130910+0000", 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3380000000000005e-06 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130948+0000", 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8260000000000003e-05 2024-09-17T16:42:07.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130954+0000", 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0279999999999997e-06 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.131045+0000", 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1032999999999994e-05 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:07.095 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:07.096 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:07.097 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:07.097 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:07.095+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:07.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:42:07.197 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:07.195+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:07.211 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.212 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:07.212 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:07.212 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:07.220 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:07.298 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:07.296+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:07.324 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.324 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:07.324 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:07.324 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:07.324 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:07.333 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:07.400 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:07.398+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:07.436 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'unique_pool_0' created 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:40 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:07.438 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.634510552999998, 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074373190000000004, 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:07.439 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2800000000000003e-07 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.440 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799727+0000", 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2460000000000002e-06 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799730+0000", 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000002e-06 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.441 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799733+0000", 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8090000000000001e-06 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800083+0000", 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035020299999999999 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.442 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800164+0000", 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0520999999999997e-05 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807042+0000", 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068777980000000001 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.443 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807089+0000", 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6798999999999997e-05 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807161+0000", 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2801999999999999e-05 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.444 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.799799+0000", 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.634435321000002, 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074772149999999997, 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.445 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799799+0000", 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799799+0000", 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799800+0000", 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1699999999999999e-07 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799868+0000", 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8541999999999995e-05 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799874+0000", 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1630000000000001e-06 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799885+0000", 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0577000000000001e-05 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800562+0000", 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067746400000000002 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800642+0000", 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9856000000000003e-05 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807169+0000", 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065264839999999999 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807211+0000", 2024-09-17T16:42:07.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2638000000000001e-05 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807277+0000", 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5173999999999996e-05 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.450 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.799893+0000", 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.634341161999998, 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074766399999999997, 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799893+0000", 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799893+0000", 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799894+0000", 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1600000000000002e-07 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799896+0000", 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1679999999999998e-06 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799903+0000", 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6889999999999998e-06 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799906+0000", 2024-09-17T16:42:07.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2569999999999999e-06 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800937+0000", 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001030759 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801010+0000", 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2925999999999999e-05 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807282+0000", 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062722969999999996 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807330+0000", 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442000000000001e-05 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807370+0000", 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9786000000000002e-05 2024-09-17T16:42:07.455 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.634108114, 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073155590000000001, 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0899999999999997e-07 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800129+0000", 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1330000000000002e-06 2024-09-17T16:42:07.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800133+0000", 2024-09-17T16:42:07.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8330000000000004e-06 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800136+0000", 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7650000000000002e-06 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801379+0000", 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001243442 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801423+0000", 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3791999999999997e-05 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807378+0000", 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059548200000000004 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807409+0000", 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0997000000000002e-05 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807442+0000", 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3467999999999999e-05 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.462 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.634059982, 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073224479999999996, 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:07.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1699999999999999e-07 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800251+0000", 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5821999999999993e-05 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800256+0000", 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0289999999999996e-06 2024-09-17T16:42:07.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800259+0000", 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0860000000000002e-06 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801730+0000", 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014708499999999999 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801805+0000", 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5104999999999993e-05 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807447+0000", 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056419210000000003 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807467+0000", 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9928e-05 2024-09-17T16:42:07.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807497+0000", 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.029e-05 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.468 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633970492, 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072951520000000001, 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 45 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.469 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7000000000000001e-07 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800271+0000", 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.471 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800275+0000", 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3850000000000002e-06 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800277+0000", 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5660000000000001e-06 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802213+0000", 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001935876 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802255+0000", 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2410000000000002e-05 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807502+0000", 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052463070000000004 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807528+0000", 2024-09-17T16:42:07.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5842000000000001e-05 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807559+0000", 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1730999999999998e-05 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.474 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633953748, 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073350949999999998, 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.475 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 46 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:07.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1500000000000001e-07 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800283+0000", 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9750000000000001e-06 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.477 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800286+0000", 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9739999999999998e-06 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800289+0000", 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5380000000000001e-06 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802510+0000", 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022217769999999999 2024-09-17T16:42:07.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802584+0000", 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3157000000000004e-05 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807564+0000", 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049805780000000003 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807585+0000", 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0789999999999999e-05 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807616+0000", 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1090999999999998e-05 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633938592, 2024-09-17T16:42:07.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076694220000000004, 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 47 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:07.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3700000000000001e-07 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800343+0000", 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6451e-05 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800348+0000", 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6840000000000004e-06 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800351+0000", 2024-09-17T16:42:07.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.095e-06 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802956+0000", 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026054839999999999 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.803024+0000", 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7473999999999998e-05 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807886+0000", 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048620260000000002 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807930+0000", 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3951e-05 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807965+0000", 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5819999999999999e-05 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633878760000002, 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077200599999999999, 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.486 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 48 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9200000000000002e-07 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800358+0000", 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9080000000000002e-06 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800362+0000", 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800368+0000", 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-17T16:42:07.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.803410+0000", 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030417560000000001 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.803485+0000", 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5438000000000005e-05 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807972+0000", 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044869419999999998 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808014+0000", 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1569000000000001e-05 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808076+0000", 2024-09-17T16:42:07.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2278000000000002e-05 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633846039000002, 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077671770000000001, 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.492 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 49 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0100000000000001e-07 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800391+0000", 2024-09-17T16:42:07.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.995e-06 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800395+0000", 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8249999999999998e-06 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800397+0000", 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.644e-06 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.805675+0000", 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052781410000000001 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.805719+0000", 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3557999999999999e-05 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808082+0000", 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023630130000000002 2024-09-17T16:42:07.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808121+0000", 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8992999999999997e-05 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808156+0000", 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4706999999999998e-05 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800432+0000", 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633802155000001, 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077809740000000004, 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800432+0000", 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800432+0000", 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800433+0000", 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8900000000000001e-07 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800492+0000", 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9514e-05 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800497+0000", 2024-09-17T16:42:07.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6569999999999996e-06 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800500+0000", 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.858e-06 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.805988+0000", 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054884770000000003 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.806032+0000", 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3745000000000002e-05 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808160+0000", 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021280280000000001 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808182+0000", 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2373000000000001e-05 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808213+0000", 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1032999999999999e-05 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633729972000001, 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077710929999999998, 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.503 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.67e-07 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800507+0000", 2024-09-17T16:42:07.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8250000000000001e-06 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800510+0000", 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9950000000000001e-06 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800512+0000", 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.806632+0000", 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061203289999999999 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.806713+0000", 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0457999999999994e-05 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808218+0000", 2024-09-17T16:42:07.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001504654 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808244+0000", 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6188000000000001e-05 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808276+0000", 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1967000000000001e-05 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.508 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800515+0000", 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.633719146000001, 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078182219999999997, 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.509 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800515+0000", 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800515+0000", 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800516+0000", 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1500000000000001e-07 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800518+0000", 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9120000000000001e-06 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800521+0000", 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9469999999999999e-06 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800523+0000", 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807635+0000", 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071113890000000001 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807684+0000", 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9296999999999999e-05 2024-09-17T16:42:07.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808281+0000", 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059640699999999997 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808303+0000", 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2561999999999998e-05 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808334+0000", 2024-09-17T16:42:07.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.894767+0000", 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.539467375000001, 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065648939999999999, 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 75 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894767+0000", 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894767+0000", 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894767+0000", 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2100000000000001e-07 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894804+0000", 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6764000000000002e-05 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894811+0000", 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3069999999999999e-06 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894830+0000", 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9031000000000001e-05 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.900001+0000", 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051713009999999997 2024-09-17T16:42:07.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.900041+0000", 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0540000000000001e-05 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901254+0000", 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012129420000000001 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901280+0000", 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5846e-05 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901332+0000", 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1941999999999998e-05 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.539395731999999, 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086420360000000005, 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.75e-07 2024-09-17T16:42:07.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894845+0000", 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8599999999999998e-06 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894852+0000", 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4330000000000001e-06 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894858+0000", 2024-09-17T16:42:07.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7429999999999996e-06 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.900998+0000", 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061399779999999999 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901039+0000", 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1009e-05 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903413+0000", 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023735090000000002 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903442+0000", 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9348000000000001e-05 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903481+0000", 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8680999999999998e-05 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:96 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.429411515999998, 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007360709, 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.525 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 96 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7000000000000001e-07 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004867+0000", 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3887000000000002e-05 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004871+0000", 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7330000000000001e-06 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004874+0000", 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8739999999999999e-06 2024-09-17T16:42:07.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.008229+0000", 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00335527 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.008268+0000", 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9320000000000003e-05 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012107+0000", 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003838082 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012132+0000", 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5846999999999998e-05 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012184+0000", 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1425999999999999e-05 2024-09-17T16:42:07.530 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:97 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004884+0000", 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.429350378999999, 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007360442, 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 97 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004884+0000", 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004884+0000", 2024-09-17T16:42:07.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004885+0000", 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9700000000000003e-07 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004887+0000", 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2529999999999999e-06 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004901+0000", 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4413000000000001e-05 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004908+0000", 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.939e-06 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009087+0000", 2024-09-17T16:42:07.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041786200000000001 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009154+0000", 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7588000000000004e-05 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012188+0000", 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030332850000000001 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012211+0000", 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2860000000000001e-05 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012245+0000", 2024-09-17T16:42:07.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4187000000000003e-05 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004923+0000", 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.429311425000002, 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073966850000000001, 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004923+0000", 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004923+0000", 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004924+0000", 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004939+0000", 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004954+0000", 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4494e-05 2024-09-17T16:42:07.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004961+0000", 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.097e-06 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009517+0000", 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045560979999999997 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009561+0000", 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4038000000000001e-05 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012249+0000", 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002688134 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012276+0000", 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6499000000000002e-05 2024-09-17T16:42:07.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012320+0000", 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4336999999999999e-05 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.429259795, 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074070849999999999, 2024-09-17T16:42:07.542 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1799999999999995e-07 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005039+0000", 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4028000000000004e-05 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005052+0000", 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3063e-05 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005058+0000", 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0050000000000001e-06 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.010001+0000", 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004942915 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.010071+0000", 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0115000000000002e-05 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012326+0000", 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022541029999999999 2024-09-17T16:42:07.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012348+0000", 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2510999999999998e-05 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012382+0000", 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3827e-05 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.005068+0000", 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.42916632, 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074340029999999998, 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-17T16:42:07.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005068+0000", 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005068+0000", 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005069+0000", 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.13e-07 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005072+0000", 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5669999999999999e-06 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005080+0000", 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2830000000000004e-06 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005087+0000", 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6070000000000002e-06 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.011842+0000", 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067547930000000003 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:07.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.011896+0000", 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4175999999999998e-05 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012446+0000", 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054960299999999996 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012469+0000", 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3210999999999999e-05 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:07.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012502+0000", 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3250000000000002e-05 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:07.553 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:07.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-17T16:42:07.556 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:07.552+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:07.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:07.655 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:07.652+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:07.660 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.660 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:07.660 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:07.660 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:07.669 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:07.756 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:07.753+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:07.771 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.771 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:07.771 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:07.771 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:07.772 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:07.780 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:07.857 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:07.855+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:07.882 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [] 2024-09-17T16:42:07.882 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:07.891 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:07.958 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:07.956+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:07.994 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:07.994 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:07.994 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:07.994 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:08.002 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:08.059 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:08.057+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:08.104 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:08.104 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:08.104 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:08.104 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:08.104 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:08.112 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:08.160 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:08.158+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:08.213 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:08.213 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:08.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:08.213 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [] 2024-09-17T16:42:08.214 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:08.222 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:08.265 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:08.263+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:08.325 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:08.325 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:08.325 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:08.325 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:08.333 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:08.374 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:08.372+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:08.441 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:42:08.442 INFO:teuthology.orchestra.run.smithi060.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-17T16:42:08.462 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:08.460+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:08.479 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:08.479 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:08.488 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:08.563 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:08.561+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:08.630 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:08.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:08.631 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [] 2024-09-17T16:42:08.631 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:08.639 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:08.683 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:08.681+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:08.754 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:08.754 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:08.754 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:08.754 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:08.763 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:08.765 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:08.763+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:08.866 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:08.864+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:08.910 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:08.910 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:08.910 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:08.910 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:08.910 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:08.919 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:08.923 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:08.967 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:08.965+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:09.021 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:09.022 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:09.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:09.022 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [] 2024-09-17T16:42:09.022 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:09.030 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:09.061 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:09.074 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:09.072+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:09.079 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:09.080 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:09.097 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:09.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:09.116 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:09.135 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:09.135 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:09.135 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:09.135 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:09.144 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:09.170 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:09.168+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:09.178 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:09.178 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:09.270 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:09.268+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:09.287 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:09.288 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:09.288 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:09.288 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:09.288 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:09.297 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:09.331 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:09.348 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:09.348 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:09.365 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:09.365 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:09.371 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:09.369+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:09.382 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:09.384 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:09.398 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:09.398 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:09.415 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:09.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:09.432 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:09.440 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:09.440 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:09.449 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:09.450 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:09.450 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:09.465 DEBUG:teuthology.orchestra.run.smithi183:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-09-17T16:42:09.466 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2024-09-17T16:42:09.467 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:09.467 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:09.467 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:09.483 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:09.484 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:09.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:09.481+0000 7fc295d9b640 0 -- 172.21.15.60:0/2308333184 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fc2a021f4d0 msgr2=0x7fc2a02218c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:09.493 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:09.491+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:09.519 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight read -> 100 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight delete -> 50 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight snap_create -> 50 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight snap_remove -> 50 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight rollback -> 50 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight setattr -> 25 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight rmattr -> 25 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight copy_from -> 50 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:adding op weight append -> 100 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:ceph version 19.3.0-4975-g1889a165 (1889a165b5128787ec693450a3d1c5df5d6dc203) squid (dev) 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout:Configuration: 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout: Number of operations: 400 2024-09-17T16:42:09.520 INFO:tasks.rados.rados.0.smithi183.stdout: Number of objects: 50 2024-09-17T16:42:09.521 INFO:tasks.rados.rados.0.smithi183.stdout: Max in flight operations: 16 2024-09-17T16:42:09.521 INFO:tasks.rados.rados.0.smithi183.stdout: Object size (in bytes): 4000000 2024-09-17T16:42:09.521 INFO:tasks.rados.rados.0.smithi183.stdout: Write stride min: 400000 2024-09-17T16:42:09.521 INFO:tasks.rados.rados.0.smithi183.stdout: Write stride max: 800000 2024-09-17T16:42:09.554 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:09.554 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:09.562 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:09.574 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:09.571+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:09.675 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:09.674+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:09.702 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:09.702 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:09.706 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:09.706 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:09.715 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:09.719 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:09.719 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:09.769 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:09.776 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:09.774+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:09.781 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-17T16:42:09.448126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":81,"acting":81,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":441712,"kb_used_data":5068,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509507728,"statfs":{"total":1546188226560,"available":1545735913472,"internally_reserved":0,"allocated":5189632,"data_stored":3475664,"data_compressed":255673,"data_compressed_allocated":581632,"data_compressed_original":2068480,"omap_allocated":25521,"internal_metadata":446733391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.017588"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-09-17T16:42:08.453450+0000","last_change":"2024-09-17T16:42:08.445805+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:08.453450+0000","last_undegraded":"2024-09-17T16:42:08.453450+0000","last_fullsized":"2024-09-17T16:42:08.453450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,14,11,7,10,0],"acting":[13,2,14,11,7,10,0],"avail_no_missing":["13(0)","0(6)","2(1)","7(4)","10(5)","11(3)","14(2)"],"object_location_counts":[],"blocked_by":[5],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-09-17T16:42:07.439564+0000","last_change":"2024-09-17T16:42:07.439564+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.439564+0000","last_undegraded":"2024-09-17T16:42:07.439564+0000","last_fullsized":"2024-09-17T16:42:07.439564+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,13,8,6,12],"acting":[2,11,5,13,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":6,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-09-17T16:42:08.452725+0000","last_change":"2024-09-17T16:42:08.446225+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:08.452725+0000","last_undegraded":"2024-09-17T16:42:08.452725+0000","last_fullsized":"2024-09-17T16:42:08.452725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,14,10,9,8,4],"acting":[13,1,14,10,9,8,4],"avail_no_missing":["13(0)","1(1)","4(6)","8(5)","9(4)","10(3)","14(2)"],"object_location_counts":[],"blocked_by":[1,3,4],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-09-17T16:42:07.447390+0000","last_change":"2024-09-17T16:42:07.447390+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.447390+0000","last_undegraded":"2024-09-17T16:42:07.447390+0000","last_fullsized":"2024-09-17T16:42:07.447390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":6,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-09-17T16:42:08.452239+0000","last_change":"2024-09-17T16:42:08.445694+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:08.452239+0000","last_undegraded":"2024-09-17T16:42:08.452239+0000","last_fullsized":"2024-09-17T16:42:08.452239+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,14,6,10],"acting":[13,1,7,5,14,6,10],"avail_no_missing":["13(0)","1(1)","5(3)","6(5)","7(2)","10(6)","14(4)"],"object_location_counts":[],"blocked_by":[1,5,6],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"24'92","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T16:42:06.099635+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:42:06.099635+0000","last_peered":"2024-09-17T16:42:06.099635+0000","last_clean":"2024-09-17T16:42:06.099635+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:42:06.099635+0000","last_undegraded":"2024-09-17T16:42:06.099635+0000","last_fullsized":"2024-09-17T16:42:06.099635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T16:42:06.099678+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:42:06.099678+0000","last_peered":"2024-09-17T16:42:06.099678+0000","last_clean":"2024-09-17T16:42:06.099678+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:42:06.099678+0000","last_undegraded":"2024-09-17T16:42:06.099678+0000","last_fullsized":"2024-09-17T16:42:06.099678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T16:42:07.444238+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:42:07.444238+0000","last_peered":"2024-09-17T16:42:07.444238+0000","last_clean":"2024-09-17T16:42:07.444238+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:42:07.444238+0000","last_undegraded":"2024-09-17T16:42:07.444238+0000","last_fullsized":"2024-09-17T16:42:07.444238+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-09-17T16:42:07.447552+0000","last_change":"2024-09-17T16:42:07.447552+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.447552+0000","last_undegraded":"2024-09-17T16:42:07.447552+0000","last_fullsized":"2024-09-17T16:42:07.447552+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,3,11,10,2,7],"acting":[4,13,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T16:42:05.528303+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:42:05.528303+0000","last_peered":"2024-09-17T16:42:05.528303+0000","last_clean":"2024-09-17T16:42:05.528303+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:42:05.528303+0000","last_undegraded":"2024-09-17T16:42:05.528303+0000","last_fullsized":"2024-09-17T16:42:05.528303+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":31,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-17T16:42:08.446731+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:42:08.446731+0000","last_peered":"2024-09-17T16:42:08.446731+0000","last_clean":"2024-09-17T16:42:08.446731+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:42:08.446731+0000","last_undegraded":"2024-09-17T16:42:08.446731+0000","last_fullsized":"2024-09-17T16:42:08.446731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T16:42:07.431491+0000","last_change":"2024-09-17T16:42:07.431491+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.431491+0000","last_undegraded":"2024-09-17T16:42:07.431491+0000","last_fullsized":"2024-09-17T16:42:07.431491+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T16:42:07.448709+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:42:07.448709+0000","last_peered":"2024-09-17T16:42:07.448709+0000","last_clean":"2024-09-17T16:42:07.448709+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:42:07.448709+0000","last_undegraded":"2024-09-17T16:42:07.448709+0000","last_fullsized":"2024-09-17T16:42:07.448709+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-09-17T16:42:07.444710+0000","last_change":"2024-09-17T16:42:07.444710+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.444710+0000","last_undegraded":"2024-09-17T16:42:07.444710+0000","last_fullsized":"2024-09-17T16:42:07.444710+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T16:42:05.527095+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:42:05.527095+0000","last_peered":"2024-09-17T16:42:05.527095+0000","last_clean":"2024-09-17T16:42:05.527095+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:42:05.527095+0000","last_undegraded":"2024-09-17T16:42:05.527095+0000","last_fullsized":"2024-09-17T16:42:05.527095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-09-17T16:42:07.447372+0000","last_change":"2024-09-17T16:42:07.447372+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.447372+0000","last_undegraded":"2024-09-17T16:42:07.447372+0000","last_fullsized":"2024-09-17T16:42:07.447372+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,13],"acting":[4,6,7,0,11,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T16:42:07.446050+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:42:07.446050+0000","last_peered":"2024-09-17T16:42:07.446050+0000","last_clean":"2024-09-17T16:42:07.446050+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:42:07.446050+0000","last_undegraded":"2024-09-17T16:42:07.446050+0000","last_fullsized":"2024-09-17T16:42:07.446050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-09-17T16:42:07.451777+0000","last_change":"2024-09-17T16:42:07.451777+0000","last_active":"2024-09-17T16:42:07.431491+0000","last_peered":"2024-09-17T16:42:07.431491+0000","last_clean":"2024-09-17T16:42:07.431491+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T16:42:07.451777+0000","last_undegraded":"2024-09-17T16:42:07.451777+0000","last_fullsized":"2024-09-17T16:42:07.451777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-17T16:42:08.446200+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:42:08.446200+0000","last_peered":"2024-09-17T16:42:08.446200+0000","last_clean":"2024-09-17T16:42:08.446200+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:42:08.446200+0000","last_undegraded":"2024-09-17T16:42:08.446200+0000","last_fullsized":"2024-09-17T16:42:08.446200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":63,"acting":63,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182409,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":151609,"data_compressed":15357,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7,8,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":151609,"data_compressed":15357,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182409,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":335872,"data_stored":661398,"data_compressed":18651,"data_compressed_allocated":57344,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":162688,"data_compressed":17367,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280519,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":172939,"data_compressed":19384,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,5,6,7,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":691616,"data_compressed":23819,"data_compressed_allocated":69632,"data_compressed_original":585728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,9,10,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280519,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":331776,"data_stored":162688,"data_compressed":17367,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313224,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":344064,"data_stored":172920,"data_compressed":19384,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313224,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":344064,"data_stored":172920,"data_compressed":19384,"data_compressed_allocated":40960,"data_compressed_original":81920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247816,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215113,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":307200,"data_stored":142160,"data_compressed":13369,"data_compressed_allocated":28672,"data_compressed_original":57344,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27316,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":294912,"data_stored":132470,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215112,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":299008,"data_stored":132489,"data_compressed":11380,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182409,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":151609,"data_compressed":15357,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182407,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":319488,"data_stored":151609,"data_compressed":15357,"data_compressed_allocated":32768,"data_compressed_original":65536,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:09.819 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:09.819 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:09.826 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:09.877 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:09.875+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:09.968 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:09.968 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:09.977 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:09.978 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:09.976+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:10.079 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:10.077+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:10.080 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.080 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.089 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:10.180 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:10.177+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:10.190 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.191 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:10.281 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:10.278+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.310 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.319 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:10.382 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:10.380+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:1: write initial oid 1 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:1: seq_num 0 ranges {0=32768} 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:1: writing smithi18337221-1 from 0 to 32768 tid 1 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:2: write initial oid 2 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:2: seq_num 1 ranges {0=32768} 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:2: writing smithi18337221-2 from 0 to 32768 tid 1 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:3: write initial oid 3 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:3: seq_num 2 ranges {0=49152} 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:3: writing smithi18337221-3 from 0 to 49152 tid 1 2024-09-17T16:42:10.454 INFO:tasks.rados.rados.0.smithi183.stdout:4: write initial oid 4 2024-09-17T16:42:10.455 INFO:tasks.rados.rados.0.smithi183.stdout:4: seq_num 3 ranges {0=65536} 2024-09-17T16:42:10.455 INFO:tasks.rados.rados.0.smithi183.stdout:4: writing smithi18337221-4 from 0 to 65536 tid 1 2024-09-17T16:42:10.455 INFO:tasks.rados.rados.0.smithi183.stdout:5: write initial oid 5 2024-09-17T16:42:10.455 INFO:tasks.rados.rados.0.smithi183.stdout:5: seq_num 4 ranges {0=81920} 2024-09-17T16:42:10.456 INFO:tasks.rados.rados.0.smithi183.stdout:5: writing smithi18337221-5 from 0 to 81920 tid 1 2024-09-17T16:42:10.456 INFO:tasks.rados.rados.0.smithi183.stdout:6: write initial oid 6 2024-09-17T16:42:10.456 INFO:tasks.rados.rados.0.smithi183.stdout:6: seq_num 5 ranges {0=98304} 2024-09-17T16:42:10.456 INFO:tasks.rados.rados.0.smithi183.stdout:6: writing smithi18337221-6 from 0 to 98304 tid 1 2024-09-17T16:42:10.456 INFO:tasks.rados.rados.0.smithi183.stdout:7: write initial oid 7 2024-09-17T16:42:10.456 INFO:tasks.rados.rados.0.smithi183.stdout:7: seq_num 6 ranges {0=114688} 2024-09-17T16:42:10.457 INFO:tasks.rados.rados.0.smithi183.stdout:7: writing smithi18337221-7 from 0 to 114688 tid 1 2024-09-17T16:42:10.457 INFO:tasks.rados.rados.0.smithi183.stdout:8: write initial oid 8 2024-09-17T16:42:10.457 INFO:tasks.rados.rados.0.smithi183.stdout:8: seq_num 7 ranges {0=131072} 2024-09-17T16:42:10.458 INFO:tasks.rados.rados.0.smithi183.stdout:8: writing smithi18337221-8 from 0 to 131072 tid 1 2024-09-17T16:42:10.458 INFO:tasks.rados.rados.0.smithi183.stdout:9: write initial oid 9 2024-09-17T16:42:10.458 INFO:tasks.rados.rados.0.smithi183.stdout:9: seq_num 8 ranges {0=147456} 2024-09-17T16:42:10.459 INFO:tasks.rados.rados.0.smithi183.stdout:9: writing smithi18337221-9 from 0 to 147456 tid 1 2024-09-17T16:42:10.459 INFO:tasks.rados.rados.0.smithi183.stdout:10: write initial oid 10 2024-09-17T16:42:10.459 INFO:tasks.rados.rados.0.smithi183.stdout:10: seq_num 9 ranges {0=163840} 2024-09-17T16:42:10.460 INFO:tasks.rados.rados.0.smithi183.stdout:10: writing smithi18337221-10 from 0 to 163840 tid 1 2024-09-17T16:42:10.460 INFO:tasks.rados.rados.0.smithi183.stdout:11: write initial oid 11 2024-09-17T16:42:10.461 INFO:tasks.rados.rados.0.smithi183.stdout:11: seq_num 10 ranges {0=180224} 2024-09-17T16:42:10.462 INFO:tasks.rados.rados.0.smithi183.stdout:11: writing smithi18337221-11 from 0 to 180224 tid 1 2024-09-17T16:42:10.462 INFO:tasks.rados.rados.0.smithi183.stdout:12: write initial oid 12 2024-09-17T16:42:10.462 INFO:tasks.rados.rados.0.smithi183.stdout:12: seq_num 11 ranges {0=196608} 2024-09-17T16:42:10.463 INFO:tasks.rados.rados.0.smithi183.stdout:12: writing smithi18337221-12 from 0 to 196608 tid 1 2024-09-17T16:42:10.463 INFO:tasks.rados.rados.0.smithi183.stdout:13: write initial oid 13 2024-09-17T16:42:10.463 INFO:tasks.rados.rados.0.smithi183.stdout:13: seq_num 12 ranges {0=212992} 2024-09-17T16:42:10.465 INFO:tasks.rados.rados.0.smithi183.stdout:13: writing smithi18337221-13 from 0 to 212992 tid 1 2024-09-17T16:42:10.465 INFO:tasks.rados.rados.0.smithi183.stdout:14: write initial oid 14 2024-09-17T16:42:10.465 INFO:tasks.rados.rados.0.smithi183.stdout:14: seq_num 13 ranges {0=229376} 2024-09-17T16:42:10.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:42:10.467 INFO:tasks.rados.rados.0.smithi183.stdout:14: writing smithi18337221-14 from 0 to 229376 tid 1 2024-09-17T16:42:10.467 INFO:tasks.rados.rados.0.smithi183.stdout:15: write initial oid 15 2024-09-17T16:42:10.467 INFO:tasks.rados.rados.0.smithi183.stdout:15: seq_num 14 ranges {0=245760} 2024-09-17T16:42:10.468 INFO:tasks.rados.rados.0.smithi183.stdout:15: writing smithi18337221-15 from 0 to 245760 tid 1 2024-09-17T16:42:10.469 INFO:tasks.rados.rados.0.smithi183.stdout:16: write initial oid 16 2024-09-17T16:42:10.469 INFO:tasks.rados.rados.0.smithi183.stdout:16: seq_num 15 ranges {0=262144} 2024-09-17T16:42:10.470 INFO:tasks.rados.rados.0.smithi183.stdout:16: writing smithi18337221-16 from 0 to 262144 tid 1 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:3: finishing write tid 1 to smithi18337221-3 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:4: finishing write tid 1 to smithi18337221-4 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:3: finishing write tid 2 to smithi18337221-3 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:1: finishing write tid 1 to smithi18337221-1 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:5: finishing write tid 1 to smithi18337221-5 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:5: finishing write tid 2 to smithi18337221-5 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:2: finishing write tid 1 to smithi18337221-2 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:1: finishing write tid 2 to smithi18337221-1 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:5: finishing write tid 3 to smithi18337221-5 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:5: oid 5 updating version 0 to 1 2024-09-17T16:42:10.471 INFO:tasks.rados.rados.0.smithi183.stdout:5: oid 5 updating version 1 to 2 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:2: finishing write tid 2 to smithi18337221-2 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:4: finishing write tid 2 to smithi18337221-4 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:5: done (15 left) 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:17: write initial oid 17 2024-09-17T16:42:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:17: seq_num 16 ranges {0=278528} 2024-09-17T16:42:10.473 INFO:tasks.rados.rados.0.smithi183.stdout:17: writing smithi18337221-17 from 0 to 278528 tid 1 2024-09-17T16:42:10.473 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.473 INFO:tasks.rados.rados.0.smithi183.stdout:8: finishing write tid 1 to smithi18337221-8 2024-09-17T16:42:10.473 INFO:tasks.rados.rados.0.smithi183.stdout:8: finishing write tid 2 to smithi18337221-8 2024-09-17T16:42:10.473 INFO:tasks.rados.rados.0.smithi183.stdout:4: finishing write tid 3 to smithi18337221-4 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:4: oid 4 updating version 0 to 1 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:4: oid 4 updating version 1 to 2 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:7: finishing write tid 1 to smithi18337221-7 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:6: finishing write tid 1 to smithi18337221-6 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:6: finishing write tid 2 to smithi18337221-6 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:1: finishing write tid 3 to smithi18337221-1 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:1: oid 1 updating version 0 to 1 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:1: oid 1 updating version 1 to 2 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-09-17T16:42:10.474 INFO:tasks.rados.rados.0.smithi183.stdout:8: finishing write tid 3 to smithi18337221-8 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:8: oid 8 updating version 0 to 3 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:8: oid 8 updating version 3 to 4 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 8 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:1: done (15 left) 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:4: done (14 left) 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:8: done (13 left) 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:18: write initial oid 18 2024-09-17T16:42:10.475 INFO:tasks.rados.rados.0.smithi183.stdout:18: seq_num 17 ranges {0=294912} 2024-09-17T16:42:10.476 INFO:tasks.rados.rados.0.smithi183.stdout:18: writing smithi18337221-18 from 0 to 294912 tid 1 2024-09-17T16:42:10.476 INFO:tasks.rados.rados.0.smithi183.stdout:19: write initial oid 19 2024-09-17T16:42:10.476 INFO:tasks.rados.rados.0.smithi183.stdout:19: seq_num 18 ranges {0=311296} 2024-09-17T16:42:10.478 INFO:tasks.rados.rados.0.smithi183.stdout:19: writing smithi18337221-19 from 0 to 311296 tid 1 2024-09-17T16:42:10.478 INFO:tasks.rados.rados.0.smithi183.stdout:20: write initial oid 20 2024-09-17T16:42:10.478 INFO:tasks.rados.rados.0.smithi183.stdout:20: seq_num 19 ranges {0=327680} 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:20: writing smithi18337221-20 from 0 to 327680 tid 1 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:3: finishing write tid 3 to smithi18337221-3 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:3: oid 3 updating version 0 to 1 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:3: oid 3 updating version 1 to 2 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:6: finishing write tid 3 to smithi18337221-6 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:6: oid 6 updating version 0 to 1 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:6: oid 6 updating version 1 to 2 2024-09-17T16:42:10.480 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-17T16:42:10.481 INFO:tasks.rados.rados.0.smithi183.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-09-17T16:42:10.481 INFO:tasks.rados.rados.0.smithi183.stdout:10: finishing write tid 1 to smithi18337221-10 2024-09-17T16:42:10.481 INFO:tasks.rados.rados.0.smithi183.stdout:3: done (15 left) 2024-09-17T16:42:10.481 INFO:tasks.rados.rados.0.smithi183.stdout:6: done (14 left) 2024-09-17T16:42:10.481 INFO:tasks.rados.rados.0.smithi183.stdout:21: write initial oid 21 2024-09-17T16:42:10.481 INFO:tasks.rados.rados.0.smithi183.stdout:21: seq_num 20 ranges {0=344064} 2024-09-17T16:42:10.482 INFO:tasks.rados.rados.0.smithi183.stdout:21: writing smithi18337221-21 from 0 to 344064 tid 1 2024-09-17T16:42:10.482 INFO:tasks.rados.rados.0.smithi183.stdout:22: write initial oid 22 2024-09-17T16:42:10.482 INFO:tasks.rados.rados.0.smithi183.stdout:22: seq_num 21 ranges {0=360448} 2024-09-17T16:42:10.482 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:10.480+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:10.486 INFO:tasks.rados.rados.0.smithi183.stdout:22: writing smithi18337221-22 from 0 to 360448 tid 1 2024-09-17T16:42:10.486 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.487 INFO:tasks.rados.rados.0.smithi183.stdout:2: finishing write tid 3 to smithi18337221-2 2024-09-17T16:42:10.487 INFO:tasks.rados.rados.0.smithi183.stdout:2: oid 2 updating version 0 to 1 2024-09-17T16:42:10.487 INFO:tasks.rados.rados.0.smithi183.stdout:2: oid 2 updating version 1 to 2 2024-09-17T16:42:10.487 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-17T16:42:10.487 INFO:tasks.rados.rados.0.smithi183.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-09-17T16:42:10.488 INFO:tasks.rados.rados.0.smithi183.stdout:10: finishing write tid 2 to smithi18337221-10 2024-09-17T16:42:10.488 INFO:tasks.rados.rados.0.smithi183.stdout:9: finishing write tid 1 to smithi18337221-9 2024-09-17T16:42:10.488 INFO:tasks.rados.rados.0.smithi183.stdout:9: finishing write tid 2 to smithi18337221-9 2024-09-17T16:42:10.488 INFO:tasks.rados.rados.0.smithi183.stdout:7: finishing write tid 2 to smithi18337221-7 2024-09-17T16:42:10.488 INFO:tasks.rados.rados.0.smithi183.stdout:7: finishing write tid 3 to smithi18337221-7 2024-09-17T16:42:10.488 INFO:tasks.rados.rados.0.smithi183.stdout:7: oid 7 updating version 0 to 1 2024-09-17T16:42:10.489 INFO:tasks.rados.rados.0.smithi183.stdout:7: oid 7 updating version 1 to 2 2024-09-17T16:42:10.489 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-09-17T16:42:10.489 INFO:tasks.rados.rados.0.smithi183.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-09-17T16:42:10.489 INFO:tasks.rados.rados.0.smithi183.stdout:10: finishing write tid 3 to smithi18337221-10 2024-09-17T16:42:10.489 INFO:tasks.rados.rados.0.smithi183.stdout:10: oid 10 updating version 0 to 2 2024-09-17T16:42:10.490 INFO:tasks.rados.rados.0.smithi183.stdout:10: oid 10 version 2 is already newer than 1 2024-09-17T16:42:10.490 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 10 v 2 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-17T16:42:10.490 INFO:tasks.rados.rados.0.smithi183.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-09-17T16:42:10.490 INFO:tasks.rados.rados.0.smithi183.stdout:9: finishing write tid 3 to smithi18337221-9 2024-09-17T16:42:10.491 INFO:tasks.rados.rados.0.smithi183.stdout:9: oid 9 updating version 0 to 3 2024-09-17T16:42:10.491 INFO:tasks.rados.rados.0.smithi183.stdout:9: oid 9 updating version 3 to 4 2024-09-17T16:42:10.491 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 9 v 4 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-17T16:42:10.491 INFO:tasks.rados.rados.0.smithi183.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:10.491 INFO:tasks.rados.rados.0.smithi183.stdout:12: finishing write tid 1 to smithi18337221-12 2024-09-17T16:42:10.492 INFO:tasks.rados.rados.0.smithi183.stdout:12: finishing write tid 2 to smithi18337221-12 2024-09-17T16:42:10.492 INFO:tasks.rados.rados.0.smithi183.stdout:12: finishing write tid 3 to smithi18337221-12 2024-09-17T16:42:10.492 INFO:tasks.rados.rados.0.smithi183.stdout:12: oid 12 updating version 0 to 3 2024-09-17T16:42:10.492 INFO:tasks.rados.rados.0.smithi183.stdout:12: oid 12 updating version 3 to 4 2024-09-17T16:42:10.492 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 12 v 4 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-17T16:42:10.493 INFO:tasks.rados.rados.0.smithi183.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:10.493 INFO:tasks.rados.rados.0.smithi183.stdout:2: done (15 left) 2024-09-17T16:42:10.493 INFO:tasks.rados.rados.0.smithi183.stdout:7: done (14 left) 2024-09-17T16:42:10.493 INFO:tasks.rados.rados.0.smithi183.stdout:9: done (13 left) 2024-09-17T16:42:10.493 INFO:tasks.rados.rados.0.smithi183.stdout:10: done (12 left) 2024-09-17T16:42:10.494 INFO:tasks.rados.rados.0.smithi183.stdout:12: done (11 left) 2024-09-17T16:42:10.494 INFO:tasks.rados.rados.0.smithi183.stdout:23: write initial oid 23 2024-09-17T16:42:10.494 INFO:tasks.rados.rados.0.smithi183.stdout:23: seq_num 22 ranges {0=376832} 2024-09-17T16:42:10.500 INFO:tasks.rados.rados.0.smithi183.stdout:23: writing smithi18337221-23 from 0 to 376832 tid 1 2024-09-17T16:42:10.500 INFO:tasks.rados.rados.0.smithi183.stdout:24: write initial oid 24 2024-09-17T16:42:10.500 INFO:tasks.rados.rados.0.smithi183.stdout:24: seq_num 23 ranges {0=393216} 2024-09-17T16:42:10.500 INFO:tasks.rados.rados.0.smithi183.stdout:24: writing smithi18337221-24 from 0 to 393216 tid 1 2024-09-17T16:42:10.501 INFO:tasks.rados.rados.0.smithi183.stdout:25: write initial oid 25 2024-09-17T16:42:10.501 INFO:tasks.rados.rados.0.smithi183.stdout:25: seq_num 24 ranges {0=409600} 2024-09-17T16:42:10.501 INFO:tasks.rados.rados.0.smithi183.stdout:25: writing smithi18337221-25 from 0 to 409600 tid 1 2024-09-17T16:42:10.501 INFO:tasks.rados.rados.0.smithi183.stdout:26: write initial oid 26 2024-09-17T16:42:10.501 INFO:tasks.rados.rados.0.smithi183.stdout:26: seq_num 25 ranges {0=425984} 2024-09-17T16:42:10.502 INFO:tasks.rados.rados.0.smithi183.stdout:26: writing smithi18337221-26 from 0 to 425984 tid 1 2024-09-17T16:42:10.502 INFO:tasks.rados.rados.0.smithi183.stdout:27: write initial oid 27 2024-09-17T16:42:10.502 INFO:tasks.rados.rados.0.smithi183.stdout:27: seq_num 26 ranges {0=442368} 2024-09-17T16:42:10.502 INFO:tasks.rados.rados.0.smithi183.stdout:27: writing smithi18337221-27 from 0 to 442368 tid 1 2024-09-17T16:42:10.502 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.503 INFO:tasks.rados.rados.0.smithi183.stdout:11: finishing write tid 1 to smithi18337221-11 2024-09-17T16:42:10.503 INFO:tasks.rados.rados.0.smithi183.stdout:15: finishing write tid 1 to smithi18337221-15 2024-09-17T16:42:10.503 INFO:tasks.rados.rados.0.smithi183.stdout:11: finishing write tid 2 to smithi18337221-11 2024-09-17T16:42:10.503 INFO:tasks.rados.rados.0.smithi183.stdout:13: finishing write tid 1 to smithi18337221-13 2024-09-17T16:42:10.503 INFO:tasks.rados.rados.0.smithi183.stdout:13: finishing write tid 2 to smithi18337221-13 2024-09-17T16:42:10.503 INFO:tasks.rados.rados.0.smithi183.stdout:11: finishing write tid 3 to smithi18337221-11 2024-09-17T16:42:10.504 INFO:tasks.rados.rados.0.smithi183.stdout:11: oid 11 updating version 0 to 6 2024-09-17T16:42:10.504 INFO:tasks.rados.rados.0.smithi183.stdout:11: oid 11 version 6 is already newer than 5 2024-09-17T16:42:10.504 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 6 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-09-17T16:42:10.504 INFO:tasks.rados.rados.0.smithi183.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-09-17T16:42:10.504 INFO:tasks.rados.rados.0.smithi183.stdout:13: finishing write tid 3 to smithi18337221-13 2024-09-17T16:42:10.505 INFO:tasks.rados.rados.0.smithi183.stdout:13: oid 13 updating version 0 to 1 2024-09-17T16:42:10.505 INFO:tasks.rados.rados.0.smithi183.stdout:13: oid 13 updating version 1 to 2 2024-09-17T16:42:10.505 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 13 v 2 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-17T16:42:10.505 INFO:tasks.rados.rados.0.smithi183.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-09-17T16:42:10.505 INFO:tasks.rados.rados.0.smithi183.stdout:16: finishing write tid 1 to smithi18337221-16 2024-09-17T16:42:10.505 INFO:tasks.rados.rados.0.smithi183.stdout:17: finishing write tid 1 to smithi18337221-17 2024-09-17T16:42:10.506 INFO:tasks.rados.rados.0.smithi183.stdout:17: finishing write tid 2 to smithi18337221-17 2024-09-17T16:42:10.506 INFO:tasks.rados.rados.0.smithi183.stdout:17: finishing write tid 3 to smithi18337221-17 2024-09-17T16:42:10.506 INFO:tasks.rados.rados.0.smithi183.stdout:17: oid 17 updating version 0 to 3 2024-09-17T16:42:10.506 INFO:tasks.rados.rados.0.smithi183.stdout:17: oid 17 updating version 3 to 4 2024-09-17T16:42:10.506 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 17 v 4 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T16:42:10.507 INFO:tasks.rados.rados.0.smithi183.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:42:10.507 INFO:tasks.rados.rados.0.smithi183.stdout:18: finishing write tid 1 to smithi18337221-18 2024-09-17T16:42:10.507 INFO:tasks.rados.rados.0.smithi183.stdout:18: finishing write tid 2 to smithi18337221-18 2024-09-17T16:42:10.507 INFO:tasks.rados.rados.0.smithi183.stdout:11: done (15 left) 2024-09-17T16:42:10.507 INFO:tasks.rados.rados.0.smithi183.stdout:13: done (14 left) 2024-09-17T16:42:10.507 INFO:tasks.rados.rados.0.smithi183.stdout:17: done (13 left) 2024-09-17T16:42:10.508 INFO:tasks.rados.rados.0.smithi183.stdout:28: write initial oid 28 2024-09-17T16:42:10.508 INFO:tasks.rados.rados.0.smithi183.stdout:28: seq_num 27 ranges {0=458752} 2024-09-17T16:42:10.513 INFO:tasks.rados.rados.0.smithi183.stdout:28: writing smithi18337221-28 from 0 to 458752 tid 1 2024-09-17T16:42:10.513 INFO:tasks.rados.rados.0.smithi183.stdout:29: write initial oid 29 2024-09-17T16:42:10.513 INFO:tasks.rados.rados.0.smithi183.stdout:29: seq_num 28 ranges {0=475136} 2024-09-17T16:42:10.513 INFO:tasks.rados.rados.0.smithi183.stdout:29: writing smithi18337221-29 from 0 to 475136 tid 1 2024-09-17T16:42:10.514 INFO:tasks.rados.rados.0.smithi183.stdout:30: write initial oid 30 2024-09-17T16:42:10.514 INFO:tasks.rados.rados.0.smithi183.stdout:30: seq_num 29 ranges {0=491520} 2024-09-17T16:42:10.514 INFO:tasks.rados.rados.0.smithi183.stdout:30: writing smithi18337221-30 from 0 to 491520 tid 1 2024-09-17T16:42:10.514 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.514 INFO:tasks.rados.rados.0.smithi183.stdout:18: finishing write tid 3 to smithi18337221-18 2024-09-17T16:42:10.515 INFO:tasks.rados.rados.0.smithi183.stdout:18: oid 18 updating version 0 to 2 2024-09-17T16:42:10.515 INFO:tasks.rados.rados.0.smithi183.stdout:18: oid 18 version 2 is already newer than 1 2024-09-17T16:42:10.515 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 18 v 2 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-09-17T16:42:10.515 INFO:tasks.rados.rados.0.smithi183.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-09-17T16:42:10.515 INFO:tasks.rados.rados.0.smithi183.stdout:16: finishing write tid 2 to smithi18337221-16 2024-09-17T16:42:10.515 INFO:tasks.rados.rados.0.smithi183.stdout:15: finishing write tid 2 to smithi18337221-15 2024-09-17T16:42:10.516 INFO:tasks.rados.rados.0.smithi183.stdout:19: finishing write tid 1 to smithi18337221-19 2024-09-17T16:42:10.516 INFO:tasks.rados.rados.0.smithi183.stdout:19: finishing write tid 2 to smithi18337221-19 2024-09-17T16:42:10.516 INFO:tasks.rados.rados.0.smithi183.stdout:18: done (15 left) 2024-09-17T16:42:10.516 INFO:tasks.rados.rados.0.smithi183.stdout:31: write initial oid 31 2024-09-17T16:42:10.517 INFO:tasks.rados.rados.0.smithi183.stdout:31: seq_num 30 ranges {0=507904} 2024-09-17T16:42:10.517 INFO:tasks.rados.rados.0.smithi183.stdout:31: writing smithi18337221-31 from 0 to 507904 tid 1 2024-09-17T16:42:10.517 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.517 INFO:tasks.rados.rados.0.smithi183.stdout:20: finishing write tid 1 to smithi18337221-20 2024-09-17T16:42:10.517 INFO:tasks.rados.rados.0.smithi183.stdout:20: finishing write tid 2 to smithi18337221-20 2024-09-17T16:42:10.517 INFO:tasks.rados.rados.0.smithi183.stdout:15: finishing write tid 3 to smithi18337221-15 2024-09-17T16:42:10.518 INFO:tasks.rados.rados.0.smithi183.stdout:15: oid 15 updating version 0 to 3 2024-09-17T16:42:10.518 INFO:tasks.rados.rados.0.smithi183.stdout:15: oid 15 updating version 3 to 4 2024-09-17T16:42:10.518 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 4 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-09-17T16:42:10.518 INFO:tasks.rados.rados.0.smithi183.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-09-17T16:42:10.518 INFO:tasks.rados.rados.0.smithi183.stdout:19: finishing write tid 3 to smithi18337221-19 2024-09-17T16:42:10.519 INFO:tasks.rados.rados.0.smithi183.stdout:19: oid 19 updating version 0 to 4 2024-09-17T16:42:10.519 INFO:tasks.rados.rados.0.smithi183.stdout:19: oid 19 version 4 is already newer than 3 2024-09-17T16:42:10.519 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 19 v 4 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-09-17T16:42:10.519 INFO:tasks.rados.rados.0.smithi183.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-09-17T16:42:10.519 INFO:tasks.rados.rados.0.smithi183.stdout:14: finishing write tid 1 to smithi18337221-14 2024-09-17T16:42:10.519 INFO:tasks.rados.rados.0.smithi183.stdout:16: finishing write tid 3 to smithi18337221-16 2024-09-17T16:42:10.520 INFO:tasks.rados.rados.0.smithi183.stdout:16: oid 16 updating version 0 to 4 2024-09-17T16:42:10.520 INFO:tasks.rados.rados.0.smithi183.stdout:16: oid 16 version 4 is already newer than 3 2024-09-17T16:42:10.520 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 16 v 4 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-09-17T16:42:10.520 INFO:tasks.rados.rados.0.smithi183.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-09-17T16:42:10.520 INFO:tasks.rados.rados.0.smithi183.stdout:14: finishing write tid 2 to smithi18337221-14 2024-09-17T16:42:10.521 INFO:tasks.rados.rados.0.smithi183.stdout:15: done (15 left) 2024-09-17T16:42:10.521 INFO:tasks.rados.rados.0.smithi183.stdout:16: done (14 left) 2024-09-17T16:42:10.521 INFO:tasks.rados.rados.0.smithi183.stdout:19: done (13 left) 2024-09-17T16:42:10.521 INFO:tasks.rados.rados.0.smithi183.stdout:32: write initial oid 32 2024-09-17T16:42:10.521 INFO:tasks.rados.rados.0.smithi183.stdout:32: seq_num 31 ranges {0=524288} 2024-09-17T16:42:10.526 INFO:tasks.rados.rados.0.smithi183.stdout:32: writing smithi18337221-32 from 0 to 524288 tid 1 2024-09-17T16:42:10.527 INFO:tasks.rados.rados.0.smithi183.stdout:33: write initial oid 33 2024-09-17T16:42:10.527 INFO:tasks.rados.rados.0.smithi183.stdout:33: seq_num 32 ranges {0=540672} 2024-09-17T16:42:10.527 INFO:tasks.rados.rados.0.smithi183.stdout:33: writing smithi18337221-33 from 0 to 540672 tid 1 2024-09-17T16:42:10.527 INFO:tasks.rados.rados.0.smithi183.stdout:34: write initial oid 34 2024-09-17T16:42:10.527 INFO:tasks.rados.rados.0.smithi183.stdout:34: seq_num 33 ranges {0=557056} 2024-09-17T16:42:10.528 INFO:tasks.rados.rados.0.smithi183.stdout:34: writing smithi18337221-34 from 0 to 557056 tid 1 2024-09-17T16:42:10.528 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.528 INFO:tasks.rados.rados.0.smithi183.stdout:14: finishing write tid 3 to smithi18337221-14 2024-09-17T16:42:10.528 INFO:tasks.rados.rados.0.smithi183.stdout:14: oid 14 updating version 0 to 8 2024-09-17T16:42:10.528 INFO:tasks.rados.rados.0.smithi183.stdout:14: oid 14 version 8 is already newer than 7 2024-09-17T16:42:10.529 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 14 v 8 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-17T16:42:10.529 INFO:tasks.rados.rados.0.smithi183.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-09-17T16:42:10.529 INFO:tasks.rados.rados.0.smithi183.stdout:24: finishing write tid 1 to smithi18337221-24 2024-09-17T16:42:10.529 INFO:tasks.rados.rados.0.smithi183.stdout:24: finishing write tid 2 to smithi18337221-24 2024-09-17T16:42:10.529 INFO:tasks.rados.rados.0.smithi183.stdout:24: finishing write tid 3 to smithi18337221-24 2024-09-17T16:42:10.530 INFO:tasks.rados.rados.0.smithi183.stdout:24: oid 24 updating version 0 to 5 2024-09-17T16:42:10.530 INFO:tasks.rados.rados.0.smithi183.stdout:24: oid 24 updating version 5 to 6 2024-09-17T16:42:10.530 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 24 v 6 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-09-17T16:42:10.530 INFO:tasks.rados.rados.0.smithi183.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-09-17T16:42:10.530 INFO:tasks.rados.rados.0.smithi183.stdout:26: finishing write tid 1 to smithi18337221-26 2024-09-17T16:42:10.530 INFO:tasks.rados.rados.0.smithi183.stdout:22: finishing write tid 1 to smithi18337221-22 2024-09-17T16:42:10.531 INFO:tasks.rados.rados.0.smithi183.stdout:22: finishing write tid 2 to smithi18337221-22 2024-09-17T16:42:10.531 INFO:tasks.rados.rados.0.smithi183.stdout:22: finishing write tid 3 to smithi18337221-22 2024-09-17T16:42:10.531 INFO:tasks.rados.rados.0.smithi183.stdout:22: oid 22 updating version 0 to 4 2024-09-17T16:42:10.531 INFO:tasks.rados.rados.0.smithi183.stdout:22: oid 22 version 4 is already newer than 3 2024-09-17T16:42:10.531 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 22 v 4 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-09-17T16:42:10.532 INFO:tasks.rados.rados.0.smithi183.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-09-17T16:42:10.532 INFO:tasks.rados.rados.0.smithi183.stdout:23: finishing write tid 1 to smithi18337221-23 2024-09-17T16:42:10.532 INFO:tasks.rados.rados.0.smithi183.stdout:23: finishing write tid 2 to smithi18337221-23 2024-09-17T16:42:10.532 INFO:tasks.rados.rados.0.smithi183.stdout:26: finishing write tid 2 to smithi18337221-26 2024-09-17T16:42:10.532 INFO:tasks.rados.rados.0.smithi183.stdout:14: done (15 left) 2024-09-17T16:42:10.533 INFO:tasks.rados.rados.0.smithi183.stdout:22: done (14 left) 2024-09-17T16:42:10.533 INFO:tasks.rados.rados.0.smithi183.stdout:24: done (13 left) 2024-09-17T16:42:10.533 INFO:tasks.rados.rados.0.smithi183.stdout:35: write initial oid 35 2024-09-17T16:42:10.533 INFO:tasks.rados.rados.0.smithi183.stdout:35: seq_num 34 ranges {0=573440} 2024-09-17T16:42:10.533 INFO:tasks.rados.rados.0.smithi183.stdout:35: writing smithi18337221-35 from 0 to 573440 tid 1 2024-09-17T16:42:10.533 INFO:tasks.rados.rados.0.smithi183.stdout:36: write initial oid 36 2024-09-17T16:42:10.534 INFO:tasks.rados.rados.0.smithi183.stdout:36: seq_num 35 ranges {0=589824} 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout:36: writing smithi18337221-36 from 0 to 589824 tid 1 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout:37: write initial oid 37 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout:37: seq_num 36 ranges {0=606208} 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout:37: writing smithi18337221-37 from 0 to 606208 tid 1 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout:26: finishing write tid 3 to smithi18337221-26 2024-09-17T16:42:10.536 INFO:tasks.rados.rados.0.smithi183.stdout:26: oid 26 updating version 0 to 2 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:26: oid 26 version 2 is already newer than 1 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 26 v 2 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:25: finishing write tid 1 to smithi18337221-25 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:25: finishing write tid 2 to smithi18337221-25 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:27: finishing write tid 1 to smithi18337221-27 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:27: finishing write tid 2 to smithi18337221-27 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:21: finishing write tid 1 to smithi18337221-21 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:23: finishing write tid 3 to smithi18337221-23 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:23: oid 23 updating version 0 to 9 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:23: oid 23 updating version 9 to 10 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 23 v 10 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-09-17T16:42:10.537 INFO:tasks.rados.rados.0.smithi183.stdout:27: finishing write tid 3 to smithi18337221-27 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:27: oid 27 updating version 0 to 2 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:27: oid 27 version 2 is already newer than 1 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 27 v 2 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:29: finishing write tid 1 to smithi18337221-29 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:21: finishing write tid 2 to smithi18337221-21 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:25: finishing write tid 3 to smithi18337221-25 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:25: oid 25 updating version 0 to 5 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:25: oid 25 updating version 5 to 6 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 25 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:30: finishing write tid 1 to smithi18337221-30 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:30: finishing write tid 2 to smithi18337221-30 2024-09-17T16:42:10.538 INFO:tasks.rados.rados.0.smithi183.stdout:30: finishing write tid 3 to smithi18337221-30 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:30: oid 30 updating version 0 to 8 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:30: oid 30 version 8 is already newer than 7 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 30 v 8 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:29: finishing write tid 2 to smithi18337221-29 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:20: finishing write tid 3 to smithi18337221-20 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:20: oid 20 updating version 0 to 2 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:20: oid 20 version 2 is already newer than 1 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 20 v 2 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:21: finishing write tid 3 to smithi18337221-21 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:21: oid 21 updating version 0 to 3 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:21: oid 21 updating version 3 to 4 2024-09-17T16:42:10.539 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 21 v 4 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:29: finishing write tid 3 to smithi18337221-29 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:29: oid 29 updating version 0 to 4 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:29: oid 29 version 4 is already newer than 3 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 29 v 4 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:31: finishing write tid 1 to smithi18337221-31 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:20: done (15 left) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:21: done (14 left) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:23: done (13 left) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:25: done (12 left) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:26: done (11 left) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:27: done (10 left) 2024-09-17T16:42:10.540 INFO:tasks.rados.rados.0.smithi183.stdout:29: done (9 left) 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:30: done (8 left) 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:38: write initial oid 38 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:38: seq_num 37 ranges {0=622592} 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:38: writing smithi18337221-38 from 0 to 622592 tid 1 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:39: write initial oid 39 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:39: seq_num 38 ranges {0=638976} 2024-09-17T16:42:10.541 INFO:tasks.rados.rados.0.smithi183.stdout:39: writing smithi18337221-39 from 0 to 638976 tid 1 2024-09-17T16:42:10.542 INFO:tasks.rados.rados.0.smithi183.stdout:40: write initial oid 40 2024-09-17T16:42:10.542 INFO:tasks.rados.rados.0.smithi183.stdout:40: seq_num 39 ranges {0=671744} 2024-09-17T16:42:10.544 INFO:tasks.rados.rados.0.smithi183.stdout:40: writing smithi18337221-40 from 0 to 671744 tid 1 2024-09-17T16:42:10.544 INFO:tasks.rados.rados.0.smithi183.stdout:41: write initial oid 41 2024-09-17T16:42:10.544 INFO:tasks.rados.rados.0.smithi183.stdout:41: seq_num 40 ranges {0=688128} 2024-09-17T16:42:10.548 INFO:tasks.rados.rados.0.smithi183.stdout:41: writing smithi18337221-41 from 0 to 688128 tid 1 2024-09-17T16:42:10.548 INFO:tasks.rados.rados.0.smithi183.stdout:42: write initial oid 42 2024-09-17T16:42:10.549 INFO:tasks.rados.rados.0.smithi183.stdout:42: seq_num 41 ranges {0=704512} 2024-09-17T16:42:10.552 INFO:tasks.rados.rados.0.smithi183.stdout:42: writing smithi18337221-42 from 0 to 704512 tid 1 2024-09-17T16:42:10.553 INFO:tasks.rados.rados.0.smithi183.stdout:43: write initial oid 43 2024-09-17T16:42:10.553 INFO:tasks.rados.rados.0.smithi183.stdout:43: seq_num 42 ranges {0=720896} 2024-09-17T16:42:10.557 INFO:tasks.rados.rados.0.smithi183.stdout:43: writing smithi18337221-43 from 0 to 720896 tid 1 2024-09-17T16:42:10.557 INFO:tasks.rados.rados.0.smithi183.stdout:44: write initial oid 44 2024-09-17T16:42:10.557 INFO:tasks.rados.rados.0.smithi183.stdout:44: seq_num 43 ranges {0=737280} 2024-09-17T16:42:10.561 INFO:tasks.rados.rados.0.smithi183.stdout:44: writing smithi18337221-44 from 0 to 737280 tid 1 2024-09-17T16:42:10.561 INFO:tasks.rados.rados.0.smithi183.stdout:45: write initial oid 45 2024-09-17T16:42:10.561 INFO:tasks.rados.rados.0.smithi183.stdout:45: seq_num 44 ranges {0=753664} 2024-09-17T16:42:10.566 INFO:tasks.rados.rados.0.smithi183.stdout:45: writing smithi18337221-45 from 0 to 753664 tid 1 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: finishing write tid 1 to smithi18337221-32 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: finishing write tid 2 to smithi18337221-32 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: finishing write tid 3 to smithi18337221-32 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: oid 32 updating version 0 to 3 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: oid 32 updating version 3 to 4 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 32 v 4 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:28: finishing write tid 1 to smithi18337221-28 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:28: finishing write tid 2 to smithi18337221-28 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:31: finishing write tid 2 to smithi18337221-31 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:32: done (15 left) 2024-09-17T16:42:10.567 INFO:tasks.rados.rados.0.smithi183.stdout:46: write initial oid 46 2024-09-17T16:42:10.568 INFO:tasks.rados.rados.0.smithi183.stdout:46: seq_num 45 ranges {0=770048} 2024-09-17T16:42:10.571 INFO:tasks.rados.rados.0.smithi183.stdout:46: writing smithi18337221-46 from 0 to 770048 tid 1 2024-09-17T16:42:10.571 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.571 INFO:tasks.rados.rados.0.smithi183.stdout:33: finishing write tid 1 to smithi18337221-33 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:28: finishing write tid 3 to smithi18337221-28 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:28: oid 28 updating version 0 to 11 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:28: oid 28 updating version 11 to 12 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 28 v 12 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:33: finishing write tid 2 to smithi18337221-33 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:31: finishing write tid 3 to smithi18337221-31 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:31: oid 31 updating version 0 to 5 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:31: oid 31 updating version 5 to 6 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 31 v 6 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:33: finishing write tid 3 to smithi18337221-33 2024-09-17T16:42:10.572 INFO:tasks.rados.rados.0.smithi183.stdout:33: oid 33 updating version 0 to 14 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:33: oid 33 version 14 is already newer than 13 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 14 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:34: finishing write tid 1 to smithi18337221-34 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:28: done (15 left) 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:31: done (14 left) 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:33: done (13 left) 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:47: write initial oid 47 2024-09-17T16:42:10.573 INFO:tasks.rados.rados.0.smithi183.stdout:47: seq_num 46 ranges {0=786432} 2024-09-17T16:42:10.576 INFO:tasks.rados.rados.0.smithi183.stdout:47: writing smithi18337221-47 from 0 to 786432 tid 1 2024-09-17T16:42:10.576 INFO:tasks.rados.rados.0.smithi183.stdout:48: write initial oid 48 2024-09-17T16:42:10.576 INFO:tasks.rados.rados.0.smithi183.stdout:48: seq_num 47 ranges {0=425984,425984=376832} 2024-09-17T16:42:10.578 INFO:tasks.rados.rados.0.smithi183.stdout:48: writing smithi18337221-48 from 0 to 425984 tid 1 2024-09-17T16:42:10.581 INFO:tasks.rados.rados.0.smithi183.stdout:48: writing smithi18337221-48 from 425984 to 802816 tid 2 2024-09-17T16:42:10.581 INFO:tasks.rados.rados.0.smithi183.stdout:49: write initial oid 49 2024-09-17T16:42:10.581 INFO:tasks.rados.rados.0.smithi183.stdout:49: seq_num 48 ranges {0=442368,442368=376832} 2024-09-17T16:42:10.583 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:10.580+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:10.584 INFO:tasks.rados.rados.0.smithi183.stdout:49: writing smithi18337221-49 from 0 to 442368 tid 1 2024-09-17T16:42:10.587 INFO:tasks.rados.rados.0.smithi183.stdout:49: writing smithi18337221-49 from 442368 to 819200 tid 2 2024-09-17T16:42:10.587 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 16 2024-09-17T16:42:10.587 INFO:tasks.rados.rados.0.smithi183.stdout:34: finishing write tid 2 to smithi18337221-34 2024-09-17T16:42:10.587 INFO:tasks.rados.rados.0.smithi183.stdout:35: finishing write tid 1 to smithi18337221-35 2024-09-17T16:42:10.587 INFO:tasks.rados.rados.0.smithi183.stdout:34: finishing write tid 3 to smithi18337221-34 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:34: oid 34 updating version 0 to 4 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:34: oid 34 version 4 is already newer than 3 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 34 v 4 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:36: finishing write tid 1 to smithi18337221-36 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:35: finishing write tid 2 to smithi18337221-35 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:35: finishing write tid 3 to smithi18337221-35 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:35: oid 35 updating version 0 to 6 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:35: oid 35 version 6 is already newer than 5 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:36: finishing write tid 2 to smithi18337221-36 2024-09-17T16:42:10.588 INFO:tasks.rados.rados.0.smithi183.stdout:34: done (15 left) 2024-09-17T16:42:10.589 INFO:tasks.rados.rados.0.smithi183.stdout:35: done (14 left) 2024-09-17T16:42:10.589 INFO:tasks.rados.rados.0.smithi183.stdout:50: write initial oid 50 2024-09-17T16:42:10.589 INFO:tasks.rados.rados.0.smithi183.stdout:50: seq_num 49 ranges {0=458752,458752=376832} 2024-09-17T16:42:10.589 INFO:tasks.rados.rados.0.smithi183.stdout:50: writing smithi18337221-50 from 0 to 458752 tid 1 2024-09-17T16:42:10.592 INFO:tasks.rados.rados.0.smithi183.stdout:50: writing smithi18337221-50 from 458752 to 835584 tid 2 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 25 current snap is 0 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:36: finishing write tid 3 to smithi18337221-36 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:36: oid 36 updating version 0 to 5 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:36: oid 36 updating version 5 to 6 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 36 v 6 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:38: finishing write tid 1 to smithi18337221-38 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:38: finishing write tid 2 to smithi18337221-38 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:37: finishing write tid 1 to smithi18337221-37 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:37: finishing write tid 2 to smithi18337221-37 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:38: finishing write tid 3 to smithi18337221-38 2024-09-17T16:42:10.593 INFO:tasks.rados.rados.0.smithi183.stdout:38: oid 38 updating version 0 to 2 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:38: oid 38 version 2 is already newer than 1 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 38 v 2 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:37: finishing write tid 3 to smithi18337221-37 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:37: oid 37 updating version 0 to 6 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:37: oid 37 version 6 is already newer than 5 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 6 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:39: finishing write tid 1 to smithi18337221-39 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:39: finishing write tid 2 to smithi18337221-39 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:39: finishing write tid 3 to smithi18337221-39 2024-09-17T16:42:10.594 INFO:tasks.rados.rados.0.smithi183.stdout:39: oid 39 updating version 0 to 1 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:39: oid 39 updating version 1 to 2 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 39 v 2 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:41: finishing write tid 1 to smithi18337221-41 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:41: finishing write tid 2 to smithi18337221-41 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:41: finishing write tid 3 to smithi18337221-41 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:41: oid 41 updating version 0 to 5 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:41: oid 41 updating version 5 to 6 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 41 v 6 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:42: finishing write tid 1 to smithi18337221-42 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:40: finishing write tid 1 to smithi18337221-40 2024-09-17T16:42:10.595 INFO:tasks.rados.rados.0.smithi183.stdout:40: finishing write tid 2 to smithi18337221-40 2024-09-17T16:42:10.596 INFO:tasks.rados.rados.0.smithi183.stdout:42: finishing write tid 2 to smithi18337221-42 2024-09-17T16:42:10.596 INFO:tasks.rados.rados.0.smithi183.stdout:51: seq_num 50 ranges {409600=475136,884736=376832} 2024-09-17T16:42:10.596 INFO:tasks.rados.rados.0.smithi183.stdout:51: writing smithi18337221-25 from 409600 to 884736 tid 1 2024-09-17T16:42:10.599 INFO:tasks.rados.rados.0.smithi183.stdout:51: writing smithi18337221-25 from 884736 to 1261568 tid 2 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:36: done (15 left) 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:37: done (14 left) 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:38: done (13 left) 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:39: done (12 left) 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:41: done (11 left) 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:52: delete oid 1 current snap is 0 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:40: finishing write tid 3 to smithi18337221-40 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:40: oid 40 updating version 0 to 5 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:40: oid 40 updating version 5 to 6 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 40 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-09-17T16:42:10.600 INFO:tasks.rados.rados.0.smithi183.stdout:43: finishing write tid 1 to smithi18337221-43 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:43: finishing write tid 2 to smithi18337221-43 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:42: finishing write tid 3 to smithi18337221-42 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:42: oid 42 updating version 0 to 10 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:42: oid 42 version 10 is already newer than 9 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 42 v 10 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:43: finishing write tid 3 to smithi18337221-43 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:43: oid 43 updating version 0 to 6 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:43: oid 43 version 6 is already newer than 5 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-09-17T16:42:10.601 INFO:tasks.rados.rados.0.smithi183.stdout:44: finishing write tid 1 to smithi18337221-44 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:44: finishing write tid 2 to smithi18337221-44 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:44: finishing write tid 3 to smithi18337221-44 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:44: oid 44 updating version 0 to 7 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:44: oid 44 updating version 7 to 8 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 44 v 8 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:45: finishing write tid 1 to smithi18337221-45 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:45: finishing write tid 2 to smithi18337221-45 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:45: finishing write tid 3 to smithi18337221-45 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:45: oid 45 updating version 0 to 15 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:45: oid 45 updating version 15 to 16 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 45 v 16 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-09-17T16:42:10.602 INFO:tasks.rados.rados.0.smithi183.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:46: finishing write tid 1 to smithi18337221-46 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:46: finishing write tid 2 to smithi18337221-46 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:46: finishing write tid 3 to smithi18337221-46 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:46: oid 46 updating version 0 to 8 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:46: oid 46 version 8 is already newer than 7 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 46 v 8 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: finishing write tid 1 to smithi18337221-48 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: finishing write tid 2 to smithi18337221-48 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: finishing write tid 3 to smithi18337221-48 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: finishing write tid 4 to smithi18337221-48 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: oid 48 updating version 0 to 5 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: oid 48 version 5 is already newer than 3 2024-09-17T16:42:10.603 INFO:tasks.rados.rados.0.smithi183.stdout:48: oid 48 version 5 is already newer than 4 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 48 v 5 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:47: finishing write tid 1 to smithi18337221-47 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:47: finishing write tid 2 to smithi18337221-47 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:47: finishing write tid 3 to smithi18337221-47 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:47: oid 47 updating version 0 to 11 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:47: oid 47 updating version 11 to 12 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 47 v 12 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:50: finishing write tid 1 to smithi18337221-50 2024-09-17T16:42:10.604 INFO:tasks.rados.rados.0.smithi183.stdout:50: finishing write tid 2 to smithi18337221-50 2024-09-17T16:42:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.605 INFO:tasks.rados.rados.0.smithi183.stdout:50: finishing write tid 3 to smithi18337221-50 2024-09-17T16:42:10.606 INFO:tasks.rados.rados.0.smithi183.stdout:50: finishing write tid 4 to smithi18337221-50 2024-09-17T16:42:10.606 INFO:tasks.rados.rados.0.smithi183.stdout:50: oid 50 updating version 0 to 5 2024-09-17T16:42:10.606 INFO:tasks.rados.rados.0.smithi183.stdout:50: oid 50 version 5 is already newer than 4 2024-09-17T16:42:10.606 INFO:tasks.rados.rados.0.smithi183.stdout:50: oid 50 version 5 is already newer than 3 2024-09-17T16:42:10.606 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 50 v 5 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-09-17T16:42:10.606 INFO:tasks.rados.rados.0.smithi183.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-09-17T16:42:10.607 INFO:tasks.rados.rados.0.smithi183.stdout:51: finishing write tid 1 to smithi18337221-25 2024-09-17T16:42:10.608 INFO:tasks.rados.rados.0.smithi183.stdout:40: done (11 left) 2024-09-17T16:42:10.608 INFO:tasks.rados.rados.0.smithi183.stdout:42: done (10 left) 2024-09-17T16:42:10.608 INFO:tasks.rados.rados.0.smithi183.stdout:43: done (9 left) 2024-09-17T16:42:10.608 INFO:tasks.rados.rados.0.smithi183.stdout:44: done (8 left) 2024-09-17T16:42:10.608 INFO:tasks.rados.rados.0.smithi183.stdout:45: done (7 left) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:46: done (6 left) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:47: done (5 left) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:48: done (4 left) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:50: done (3 left) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:52: done (2 left) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:53: read oid 28 snap -1 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:53: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 44 current snap is 0 2024-09-17T16:42:10.609 INFO:tasks.rados.rados.0.smithi183.stdout:54: seq_num 52 ranges {737280=507904,1245184=376832} 2024-09-17T16:42:10.614 INFO:tasks.rados.rados.0.smithi183.stdout:54: writing smithi18337221-44 from 737280 to 1245184 tid 1 2024-09-17T16:42:10.616 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:10.617 INFO:tasks.rados.rados.0.smithi183.stdout:54: writing smithi18337221-44 from 1245184 to 1622016 tid 2 2024-09-17T16:42:10.617 INFO:tasks.rados.rados.0.smithi183.stdout:55: rollback oid 5 current snap is 0 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:55: done (4 left) 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:56: read oid 9 snap -1 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:56: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: finishing write tid 2 to smithi18337221-25 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: finishing write tid 3 to smithi18337221-25 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: finishing write tid 4 to smithi18337221-25 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: oid 25 updating version 0 to 7 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: oid 25 updating version 7 to 8 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: oid 25 updating version 8 to 9 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 25 v 9 (ObjNum 50 snap 0 seq_num 50) dirty exists 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:51: left oid 25 (ObjNum 50 snap 0 seq_num 50) 2024-09-17T16:42:10.618 INFO:tasks.rados.rados.0.smithi183.stdout:53: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:10.619 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 180914 2024-09-17T16:42:10.624 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 399042 2024-09-17T16:42:10.624 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:10.629 INFO:tasks.rados.rados.0.smithi183.stdout:54: finishing write tid 1 to smithi18337221-44 2024-09-17T16:42:10.629 INFO:tasks.rados.rados.0.smithi183.stdout:54: finishing write tid 2 to smithi18337221-44 2024-09-17T16:42:10.629 INFO:tasks.rados.rados.0.smithi183.stdout:54: finishing write tid 3 to smithi18337221-44 2024-09-17T16:42:10.629 INFO:tasks.rados.rados.0.smithi183.stdout:54: finishing write tid 4 to smithi18337221-44 2024-09-17T16:42:10.629 INFO:tasks.rados.rados.0.smithi183.stdout:54: oid 44 updating version 0 to 9 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:54: oid 44 updating version 9 to 10 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:54: oid 44 updating version 10 to 11 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 44 v 11 (ObjNum 52 snap 0 seq_num 52) dirty exists 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:54: left oid 44 (ObjNum 52 snap 0 seq_num 52) 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:56: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:10.630 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 17380 2024-09-17T16:42:10.632 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1306 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:57: read oid 34 snap -1 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:57: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:51: done (5 left) 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:53: done (4 left) 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:54: done (3 left) 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:56: done (2 left) 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:58: copy_from oid 22 from oid 13 current snap is 0 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:59: rollback oid 35 current snap is 0 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:59: done (3 left) 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:60: copy_from oid 42 from oid 40 current snap is 0 2024-09-17T16:42:10.634 INFO:tasks.rados.rados.0.smithi183.stdout:61: snap_create 2024-09-17T16:42:10.638 INFO:tasks.rados.rados.0.smithi183.stdout:57: expect (ObjNum 33 snap 0 seq_num 33) 2024-09-17T16:42:10.638 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 133664 2024-09-17T16:42:10.644 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:10.650 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:10.655 INFO:tasks.rados.rados.0.smithi183.stdout:58: finishing copy_from racing read to smithi18337221-22 2024-09-17T16:42:10.655 INFO:tasks.rados.rados.0.smithi183.stdout:60: finishing copy_from racing read to smithi18337221-42 2024-09-17T16:42:10.655 INFO:tasks.rados.rados.0.smithi183.stdout:60: finishing copy_from to smithi18337221-42 2024-09-17T16:42:10.655 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 42 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T16:42:10.685 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:10.682+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:10.719 INFO:tasks.rados.rados.0.smithi183.stdout:49: finishing write tid 1 to smithi18337221-49 2024-09-17T16:42:10.721 INFO:tasks.rados.rados.0.smithi183.stdout:49: finishing write tid 2 to smithi18337221-49 2024-09-17T16:42:10.721 INFO:tasks.rados.rados.0.smithi183.stdout:49: finishing write tid 3 to smithi18337221-49 2024-09-17T16:42:10.721 INFO:tasks.rados.rados.0.smithi183.stdout:58: finishing copy_from to smithi18337221-22 2024-09-17T16:42:10.721 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 22 v 2 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-17T16:42:10.721 INFO:tasks.rados.rados.0.smithi183.stdout:49: finishing write tid 4 to smithi18337221-49 2024-09-17T16:42:10.722 INFO:tasks.rados.rados.0.smithi183.stdout:49: oid 49 updating version 0 to 5 2024-09-17T16:42:10.722 INFO:tasks.rados.rados.0.smithi183.stdout:49: oid 49 updating version 5 to 7 2024-09-17T16:42:10.722 INFO:tasks.rados.rados.0.smithi183.stdout:49: oid 49 version 7 is already newer than 6 2024-09-17T16:42:10.722 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 49 v 7 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-17T16:42:10.722 INFO:tasks.rados.rados.0.smithi183.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-09-17T16:42:10.734 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.734 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.743 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:10.786 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:10.784+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:10.851 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:10.851 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:10.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:10.901 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:10.899+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:10.988 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:10.986+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:11.007 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.007 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:11.089 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:11.087+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:11.123 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.123 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:11.190 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:11.187+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:11.280 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.280 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:11.290 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:11.288+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:11.391 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:11.389+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:11.396 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.396 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:11.459 INFO:tasks.rados.rados.0.smithi183.stdout:49: done (4 left) 2024-09-17T16:42:11.459 INFO:tasks.rados.rados.0.smithi183.stdout:57: done (3 left) 2024-09-17T16:42:11.459 INFO:tasks.rados.rados.0.smithi183.stdout:58: done (2 left) 2024-09-17T16:42:11.460 INFO:tasks.rados.rados.0.smithi183.stdout:60: done (1 left) 2024-09-17T16:42:11.460 INFO:tasks.rados.rados.0.smithi183.stdout:61: done (0 left) 2024-09-17T16:42:11.460 INFO:tasks.rados.rados.0.smithi183.stdout:62: snap_create 2024-09-17T16:42:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:42:11.492 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:11.490+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:11.522 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.522 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:11.592 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:11.590+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:11.638 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.639 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:11.693 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:11.691+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:11.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:11.794 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:11.792+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:11.796 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:11.796 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:11.805 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:11.857 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:11.874 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:11.891 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:11.892 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:11.895 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:11.892+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:11.909 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:11.922 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:11.922 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:11.922 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:11.925 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:11.925 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:11.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:11.942 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:11.942 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:11.959 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:11.960 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:11.977 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:11.977 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:11.993 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:11.993 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:12.009 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:12.016 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:12.013+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:12.026 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:12.026 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:12.074 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:12.074 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:12.075 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:12.075 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.083 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:12.096 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:12.094+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:12.197 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:12.195+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:12.227 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:12.227 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [] 2024-09-17T16:42:12.227 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.235 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:12.244 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:12.245 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:12.261 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:12.261 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:12.277 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:12.278 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:12.295 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:12.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:12.293+0000 7fc76bfff640 0 -- 172.21.15.60:0/2393649059 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7fc76c2244d0 msgr2=0x7fc76c2268c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:12.299 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:12.297+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:12.378 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.378 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:12.378 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:12.378 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:12.431 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:12.428+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:12.461 INFO:tasks.rados.rados.0.smithi183.stdout:62: done (0 left) 2024-09-17T16:42:12.462 INFO:tasks.rados.rados.0.smithi183.stdout:63: copy_from oid 7 from oid 13 current snap is 2 2024-09-17T16:42:12.462 INFO:tasks.rados.rados.0.smithi183.stdout:64: copy_from oid 38 from oid 9 current snap is 2 2024-09-17T16:42:12.462 INFO:tasks.rados.rados.0.smithi183.stdout:65: snap_remove snap 1 2024-09-17T16:42:12.492 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:12.493 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:12.493 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:12.502 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:12.499+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:12.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:12.604 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:12.602+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop(client.4353.0:1 2.3 e28/27 2:c4c92e5a:::rbd_trash:head v 28'1, mlcod=0'0)", 2024-09-17T16:42:12.646 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:55.133474+0000", 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.511088679, 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083617100000000003, 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133474+0000", 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133474+0000", 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133474+0000", 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4499999999999997e-07 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133484+0000", 2024-09-17T16:42:12.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5089999999999999e-06 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133507+0000", 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2951000000000001e-05 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133519+0000", 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2148e-05 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:12.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133582+0000", 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3351999999999999e-05 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.133613+0000", 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0817e-05 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.134263+0000", 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065001399999999997 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:12.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.134310+0000", 2024-09-17T16:42:12.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6734999999999999e-05 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.6s3 39/34 ECSubRead(tid=12, to_read={3:636772f7:::smithi18337221-13:head=0,53248,0}, subchunks={3:636772f7:::smithi18337221-13:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:12.464096+0000", 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.18046626900000001, 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00022546799999999999, 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:12.652 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464096+0000", 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464096+0000", 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464096+0000", 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3899999999999999e-07 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464103+0000", 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1500000000000002e-06 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464116+0000", 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2468e-05 2024-09-17T16:42:12.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464125+0000", 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7850000000000003e-06 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464203+0000", 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7275999999999997e-05 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.464321+0000", 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011865 2024-09-17T16:42:12.655 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:12.656 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:12.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:12.656 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:12.656 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:12.656 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.657 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:12.705 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:12.702+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:12.760 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.760 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:12.760 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:12.760 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.769 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:12.810 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:12.807+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:12.910 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:12.909+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:12.913 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:12.913 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:12.913 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:12.922 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:13.011 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:13.009+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:13.024 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:13.024 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:13.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:13.025 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [] 2024-09-17T16:42:13.025 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:13.033 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:13.111 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:13.108+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:13.135 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:13.135 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:13.135 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:13.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:13.213 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:13.211+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:13.285 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:13.285 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:13.285 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:13.285 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:13.285 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:13.293 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:13.313 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:13.311+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:55.137942+0000", 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.257033957000001, 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018044099999999999, 2024-09-17T16:42:13.397 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 2 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137942+0000", 2024-09-17T16:42:13.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137942+0000", 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137945+0000", 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9490000000000001e-06 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137951+0000", 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3740000000000003e-06 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137961+0000", 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7410000000000004e-06 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.137969+0000", 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0739999999999993e-06 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138018+0000", 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9104999999999998e-05 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138122+0000", 2024-09-17T16:42:13.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010419799999999999 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:55.138318+0000", 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.256657317999998, 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114098, 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 3 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138318+0000", 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138318+0000", 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138319+0000", 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138323+0000", 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1069999999999998e-06 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138332+0000", 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2020000000000004e-06 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138337+0000", 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9980000000000003e-06 2024-09-17T16:42:13.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138372+0000", 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4879000000000003e-05 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:55.138433+0000", 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1042000000000003e-05 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:56.114368+0000", 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.280607413999999, 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044041469999999997, 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:13.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 5 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114368+0000", 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114368+0000", 2024-09-17T16:42:13.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114370+0000", 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9690000000000001e-06 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114380+0000", 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2420000000000006e-06 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114395+0000", 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5849999999999999e-05 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114404+0000", 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6260000000000001e-06 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114465+0000", 2024-09-17T16:42:13.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0698000000000001e-05 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.114471+0000", 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7950000000000004e-06 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.116960+0000", 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024891510000000002 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.117071+0000", 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111024 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 12", 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.117194+0000", 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012344600000000001 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.117904+0000", 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071005799999999996 2024-09-17T16:42:13.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118680+0000", 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077541399999999999 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118726+0000", 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6443999999999998e-05 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118773+0000", 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6430000000000001e-05 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4353.0:5 2.2 e28/27 ondisk, result = 0)", 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:56.118587+0000", 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 17.276388851, 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019300799999999999, 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.414 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118587+0000", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118587+0000", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118588+0000", 2024-09-17T16:42:13.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0410000000000001e-06 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118595+0000", 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9070000000000001e-06 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118609+0000", 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3821e-05 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118617+0000", 2024-09-17T16:42:13.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8490000000000006e-06 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118668+0000", 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1578e-05 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118674+0000", 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7579999999999998e-06 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:56.118780+0000", 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000106054 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.272450673000002, 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085139050000000004, 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.418 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:13.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122527+0000", 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.813e-06 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122536+0000", 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5769999999999994e-06 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122551+0000", 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5962999999999999e-05 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122563+0000", 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1556000000000001e-05 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122628+0000", 2024-09-17T16:42:13.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4994999999999997e-05 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122635+0000", 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5560000000000004e-06 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129375+0000", 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067407320000000001 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129461+0000", 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5228000000000005e-05 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 12", 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129559+0000", 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8362000000000005e-05 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130320+0000", 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000760741 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130958+0000", 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063790199999999998 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130991+0000", 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3543000000000001e-05 2024-09-17T16:42:13.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.131039+0000", 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7936999999999999e-05 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_repop_reply(client.4353.0:7 2.2 e29/27 ondisk, result = 0)", 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:57.130882+0000", 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.264093556999999, 2024-09-17T16:42:13.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016288899999999999, 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130882+0000", 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130882+0000", 2024-09-17T16:42:13.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130883+0000", 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0380000000000001e-06 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130889+0000", 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6289999999999998e-06 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130901+0000", 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2563e-05 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130910+0000", 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3380000000000005e-06 2024-09-17T16:42:13.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130948+0000", 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8260000000000003e-05 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130954+0000", 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0279999999999997e-06 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.131045+0000", 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1032999999999994e-05 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.1s1 39/34 ECSubRead(tid=60, to_read={3:8c2ef287:::smithi18337221-9:head=0,36864,0}, subchunks={3:8c2ef287:::smithi18337221-9:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:12.469220+0000", 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.92575608200000004, 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000159352, 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:13.430 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469220+0000", 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469220+0000", 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469220+0000", 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2800000000000001e-07 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469226+0000", 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1659999999999999e-06 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:13.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469235+0000", 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0280000000000006e-06 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469243+0000", 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8210000000000002e-06 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469310+0000", 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7020000000000005e-05 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:13.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.469379+0000", 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9189000000000005e-05 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:13.434 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:13.435 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:13.436 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:13.433+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:13.470 INFO:tasks.rados.rados.0.smithi183.stdout:65: done (2 left) 2024-09-17T16:42:13.470 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 42 current snap is 2 2024-09-17T16:42:13.470 INFO:tasks.rados.rados.0.smithi183.stdout:63: finishing copy_from racing read to smithi18337221-7 2024-09-17T16:42:13.470 INFO:tasks.rados.rados.0.smithi183.stdout:66: seq_num 53 ranges {671744=524288,1196032=376832} 2024-09-17T16:42:13.476 INFO:tasks.rados.rados.0.smithi183.stdout:66: writing smithi18337221-42 from 671744 to 1196032 tid 1 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:66: writing smithi18337221-42 from 1196032 to 1572864 tid 2 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:67: copy_from oid 1 from oid 30 current snap is 2 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:63: finishing copy_from to smithi18337221-7 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 7 v 2 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:63: done (3 left) 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:68: rollback oid 33 current snap is 2 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 33 to 0 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:64: finishing copy_from racing read to smithi18337221-38 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:64: finishing copy_from to smithi18337221-38 2024-09-17T16:42:13.479 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 38 v 4 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:64: done (3 left) 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:69: copy_from oid 11 from oid 36 current snap is 2 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:70: read oid 19 snap -1 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:70: expect (ObjNum 18 snap 0 seq_num 18) 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:71: copy_from oid 47 from oid 13 current snap is 2 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:72: read oid 25 snap -1 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:72: expect (ObjNum 50 snap 0 seq_num 50) 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:73: read oid 31 snap 0 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:73: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 50 current snap is 2 2024-09-17T16:42:13.480 INFO:tasks.rados.rados.0.smithi183.stdout:74: seq_num 54 ranges {835584=540672,1376256=376832} 2024-09-17T16:42:13.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:42:13.487 INFO:tasks.rados.rados.0.smithi183.stdout:74: writing smithi18337221-50 from 835584 to 1376256 tid 1 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:74: writing smithi18337221-50 from 1376256 to 1753088 tid 2 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:75: copy_from oid 35 from oid 27 current snap is 2 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:76: read oid 41 snap -1 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:76: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:77: read oid 37 snap 0 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:77: expect (ObjNum 36 snap 0 seq_num 36) 2024-09-17T16:42:13.491 INFO:tasks.rados.rados.0.smithi183.stdout:78: rollback oid 6 current snap is 2 2024-09-17T16:42:13.492 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 6 to 0 2024-09-17T16:42:13.492 INFO:tasks.rados.rados.0.smithi183.stdout:79: snap_create 2024-09-17T16:42:13.492 INFO:tasks.rados.rados.0.smithi183.stdout:73: expect (ObjNum 30 snap 0 seq_num 30) 2024-09-17T16:42:13.494 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 407870 2024-09-17T16:42:13.496 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.506 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 112005 2024-09-17T16:42:13.511 INFO:tasks.rados.rados.0.smithi183.stdout:70: expect (ObjNum 18 snap 0 seq_num 18) 2024-09-17T16:42:13.511 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.515 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.518 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.521 INFO:tasks.rados.rados.0.smithi183.stdout:68: finishing rollback tid 0 to smithi18337221-33 2024-09-17T16:42:13.521 INFO:tasks.rados.rados.0.smithi183.stdout:68: finishing rollback tid 1 to smithi18337221-33 2024-09-17T16:42:13.521 INFO:tasks.rados.rados.0.smithi183.stdout:72: expect (ObjNum 50 snap 0 seq_num 50) 2024-09-17T16:42:13.525 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 764485 2024-09-17T16:42:13.530 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.536 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:13.534+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:13.543 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.557 INFO:tasks.rados.rados.0.smithi183.stdout:69: finishing copy_from racing read to smithi18337221-11 2024-09-17T16:42:13.557 INFO:tasks.rados.rados.0.smithi183.stdout:68: finishing rollback tid 2 to smithi18337221-33 2024-09-17T16:42:13.557 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 21 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-17T16:42:13.557 INFO:tasks.rados.rados.0.smithi183.stdout:77: expect (ObjNum 36 snap 0 seq_num 36) 2024-09-17T16:42:13.557 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.565 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 485330 2024-09-17T16:42:13.566 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:13.566 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:13.566 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:13.566 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:13.566 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.571 INFO:tasks.rados.rados.0.smithi183.stdout:66: finishing write tid 1 to smithi18337221-42 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:75: finishing copy_from racing read to smithi18337221-35 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:78: finishing rollback tid 0 to smithi18337221-6 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:69: finishing copy_from to smithi18337221-11 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 6 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:66: finishing write tid 2 to smithi18337221-42 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:78: finishing rollback tid 1 to smithi18337221-6 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:78: finishing rollback tid 2 to smithi18337221-6 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 6 v 9 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-09-17T16:42:13.572 INFO:tasks.rados.rados.0.smithi183.stdout:76: expect (ObjNum 40 snap 0 seq_num 40) 2024-09-17T16:42:13.574 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 443262 2024-09-17T16:42:13.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:13.576 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.582 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:13.588 INFO:tasks.rados.rados.0.smithi183.stdout:66: finishing write tid 3 to smithi18337221-42 2024-09-17T16:42:13.588 INFO:tasks.rados.rados.0.smithi183.stdout:74: finishing write tid 1 to smithi18337221-50 2024-09-17T16:42:13.588 INFO:tasks.rados.rados.0.smithi183.stdout:74: finishing write tid 2 to smithi18337221-50 2024-09-17T16:42:13.588 INFO:tasks.rados.rados.0.smithi183.stdout:75: finishing copy_from to smithi18337221-35 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 35 v 2 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:74: finishing write tid 3 to smithi18337221-50 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:66: finishing write tid 4 to smithi18337221-42 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:66: oid 42 updating version 0 to 15 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:66: oid 42 updating version 15 to 16 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:66: oid 42 updating version 16 to 17 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 42 v 17 (ObjNum 53 snap 2 seq_num 53) dirty exists 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:66: left oid 42 (ObjNum 53 snap 2 seq_num 53) 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:74: finishing write tid 4 to smithi18337221-50 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:74: oid 50 updating version 0 to 12 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:74: oid 50 version 12 is already newer than 9 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:74: oid 50 updating version 12 to 13 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 50 v 13 (ObjNum 54 snap 2 seq_num 54) dirty exists 2024-09-17T16:42:13.589 INFO:tasks.rados.rados.0.smithi183.stdout:74: left oid 50 (ObjNum 54 snap 2 seq_num 54) 2024-09-17T16:42:13.590 INFO:tasks.rados.rados.0.smithi183.stdout:67: finishing copy_from racing read to smithi18337221-1 2024-09-17T16:42:13.590 INFO:tasks.rados.rados.0.smithi183.stdout:71: finishing copy_from racing read to smithi18337221-47 2024-09-17T16:42:13.590 INFO:tasks.rados.rados.0.smithi183.stdout:71: finishing copy_from to smithi18337221-47 2024-09-17T16:42:13.590 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 47 v 2 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-09-17T16:42:13.590 INFO:tasks.rados.rados.0.smithi183.stdout:67: finishing copy_from to smithi18337221-1 2024-09-17T16:42:13.590 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 1 v 8 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T16:42:13.637 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:13.635+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:13.678 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:13.678 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:13.678 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:13.678 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:13.678 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:13.686 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:13.770 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:13.768+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:13.829 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:13.829 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:40 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026858049000001, 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074373190000000004, 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.830 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 40 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799724+0000", 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2800000000000003e-07 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799727+0000", 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2460000000000002e-06 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799730+0000", 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8130000000000002e-06 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799733+0000", 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8090000000000001e-06 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800083+0000", 2024-09-17T16:42:13.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035020299999999999 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800164+0000", 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0520999999999997e-05 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807042+0000", 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068777980000000001 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807089+0000", 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6798999999999997e-05 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807161+0000", 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2801999999999999e-05 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.835 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.799799+0000", 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026782817000001, 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074772149999999997, 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.836 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 41 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799799+0000", 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799799+0000", 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.837 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799800+0000", 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1699999999999999e-07 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799868+0000", 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8541999999999995e-05 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.838 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799874+0000", 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1630000000000001e-06 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799885+0000", 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0577000000000001e-05 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800562+0000", 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067746400000000002 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.839 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800642+0000", 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9856000000000003e-05 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807169+0000", 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065264839999999999 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807211+0000", 2024-09-17T16:42:13.840 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2638000000000001e-05 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807277+0000", 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5173999999999996e-05 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.841 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.799893+0000", 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026688658000001, 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074766399999999997, 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 42 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.842 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799893+0000", 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799893+0000", 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799894+0000", 2024-09-17T16:42:13.843 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1600000000000002e-07 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799896+0000", 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1679999999999998e-06 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799903+0000", 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6889999999999998e-06 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.844 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.799906+0000", 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2569999999999999e-06 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800937+0000", 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001030759 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.845 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801010+0000", 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2925999999999999e-05 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807282+0000", 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062722969999999996 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807330+0000", 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8442000000000001e-05 2024-09-17T16:42:13.846 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.847 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.847 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807370+0000", 2024-09-17T16:42:13.847 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9786000000000002e-05 2024-09-17T16:42:13.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.847 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026455609999999, 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073155590000000001, 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.848 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 43 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:13.849 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800127+0000", 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0899999999999997e-07 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800129+0000", 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1330000000000002e-06 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.850 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800133+0000", 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8330000000000004e-06 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800136+0000", 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7650000000000002e-06 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801379+0000", 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001243442 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.851 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801423+0000", 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3791999999999997e-05 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807378+0000", 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059548200000000004 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.852 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807409+0000", 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0997000000000002e-05 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807442+0000", 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3467999999999999e-05 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.853 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026407477999999, 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073224479999999996, 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.854 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 44 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.855 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800175+0000", 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1699999999999999e-07 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800251+0000", 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5821999999999993e-05 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800256+0000", 2024-09-17T16:42:13.856 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0289999999999996e-06 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800259+0000", 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0860000000000002e-06 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801730+0000", 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014708499999999999 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.857 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.801805+0000", 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5104999999999993e-05 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807447+0000", 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056419210000000003 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807467+0000", 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9928e-05 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.858 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807497+0000", 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.029e-05 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026317987999999, 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072951520000000001, 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.859 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 45 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.860 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800264+0000", 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7000000000000001e-07 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.861 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800271+0000", 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800275+0000", 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3850000000000002e-06 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800277+0000", 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5660000000000001e-06 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.862 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.863 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802213+0000", 2024-09-17T16:42:13.863 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001935876 2024-09-17T16:42:13.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802255+0000", 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2410000000000002e-05 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.864 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807502+0000", 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052463070000000004 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807528+0000", 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5842000000000001e-05 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.865 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807559+0000", 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1730999999999998e-05 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026301243999999, 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073350949999999998, 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.866 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 46 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.867 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800281+0000", 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1500000000000001e-07 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800283+0000", 2024-09-17T16:42:13.868 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9750000000000001e-06 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800286+0000", 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9739999999999998e-06 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800289+0000", 2024-09-17T16:42:13.869 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5380000000000001e-06 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802510+0000", 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022217769999999999 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802584+0000", 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3157000000000004e-05 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.870 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807564+0000", 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049805780000000003 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807585+0000", 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0789999999999999e-05 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807616+0000", 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1090999999999998e-05 2024-09-17T16:42:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026286087999999, 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076694220000000004, 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.872 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 47 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.873 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800296+0000", 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3700000000000001e-07 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800343+0000", 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6451e-05 2024-09-17T16:42:13.874 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800348+0000", 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6840000000000004e-06 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800351+0000", 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.095e-06 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.875 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.802956+0000", 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026054839999999999 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.803024+0000", 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7473999999999998e-05 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807886+0000", 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048620260000000002 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.876 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807930+0000", 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3951e-05 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807965+0000", 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5819999999999999e-05 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.877 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026226256000001, 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077200599999999999, 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.878 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 48 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.879 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800356+0000", 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9200000000000002e-07 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800358+0000", 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9080000000000002e-06 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.880 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800362+0000", 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0040000000000001e-06 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800368+0000", 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8730000000000004e-06 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.803410+0000", 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030417560000000001 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.881 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.803485+0000", 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5438000000000005e-05 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807972+0000", 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044869419999999998 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.882 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808014+0000", 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1569000000000001e-05 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808076+0000", 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2278000000000002e-05 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.883 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026193535000001, 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077671770000000001, 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 49 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.884 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800389+0000", 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0100000000000001e-07 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800391+0000", 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.995e-06 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800395+0000", 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8249999999999998e-06 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800397+0000", 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.644e-06 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.805675+0000", 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052781410000000001 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.805719+0000", 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3557999999999999e-05 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808082+0000", 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023630130000000002 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808121+0000", 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8992999999999997e-05 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808156+0000", 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4706999999999998e-05 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800432+0000", 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026149651000001, 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077809740000000004, 2024-09-17T16:42:13.889 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 50 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800432+0000", 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800432+0000", 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800433+0000", 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8900000000000001e-07 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800492+0000", 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9514e-05 2024-09-17T16:42:13.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800497+0000", 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6569999999999996e-06 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800500+0000", 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.858e-06 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.805988+0000", 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054884770000000003 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.806032+0000", 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3745000000000002e-05 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808160+0000", 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021280280000000001 2024-09-17T16:42:13.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808182+0000", 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2373000000000001e-05 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808213+0000", 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1032999999999999e-05 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026077468, 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077710929999999998, 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 51 2024-09-17T16:42:13.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800505+0000", 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.67e-07 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800507+0000", 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8250000000000001e-06 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800510+0000", 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9950000000000001e-06 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800512+0000", 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4099999999999998e-06 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.806632+0000", 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061203289999999999 2024-09-17T16:42:13.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.806713+0000", 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0457999999999994e-05 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808218+0000", 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001504654 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808244+0000", 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6188000000000001e-05 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808276+0000", 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1967000000000001e-05 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.800515+0000", 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.026066642, 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078182219999999997, 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 52 2024-09-17T16:42:13.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800515+0000", 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800515+0000", 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800516+0000", 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1500000000000001e-07 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800518+0000", 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9120000000000001e-06 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800521+0000", 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9469999999999999e-06 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.800523+0000", 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8899999999999999e-06 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807635+0000", 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071113890000000001 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.807684+0000", 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9296999999999999e-05 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808281+0000", 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059640699999999997 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808303+0000", 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2561999999999998e-05 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.808334+0000", 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.906 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.931743227999998, 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086420360000000005, 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.907 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.75e-07 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894845+0000", 2024-09-17T16:42:13.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8599999999999998e-06 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894852+0000", 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4330000000000001e-06 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894858+0000", 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7429999999999996e-06 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.900998+0000", 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061399779999999999 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901039+0000", 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1009e-05 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903413+0000", 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023735090000000002 2024-09-17T16:42:13.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903442+0000", 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9348000000000001e-05 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903481+0000", 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8680999999999998e-05 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:96 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.821759012000001, 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007360709, 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 96 2024-09-17T16:42:13.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004823+0000", 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7000000000000001e-07 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004867+0000", 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3887000000000002e-05 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004871+0000", 2024-09-17T16:42:13.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7330000000000001e-06 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004874+0000", 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8739999999999999e-06 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.008229+0000", 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00335527 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.008268+0000", 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9320000000000003e-05 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012107+0000", 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003838082 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012132+0000", 2024-09-17T16:42:13.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5846999999999998e-05 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012184+0000", 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1425999999999999e-05 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:97 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004884+0000", 2024-09-17T16:42:13.918 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.821697875000002, 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.007360442, 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 97 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004884+0000", 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004884+0000", 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004885+0000", 2024-09-17T16:42:13.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9700000000000003e-07 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004887+0000", 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2529999999999999e-06 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004901+0000", 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4413000000000001e-05 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004908+0000", 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.939e-06 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009087+0000", 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041786200000000001 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009154+0000", 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7588000000000004e-05 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012188+0000", 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0030332850000000001 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012211+0000", 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2860000000000001e-05 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012245+0000", 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4187000000000003e-05 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:98 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004923+0000", 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.821658921000001, 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073966850000000001, 2024-09-17T16:42:13.924 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 98 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004923+0000", 2024-09-17T16:42:13.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004923+0000", 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004924+0000", 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004939+0000", 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5481e-05 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004954+0000", 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4494e-05 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004961+0000", 2024-09-17T16:42:13.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.097e-06 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009517+0000", 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045560979999999997 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.009561+0000", 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4038000000000001e-05 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012249+0000", 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002688134 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012276+0000", 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6499000000000002e-05 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012320+0000", 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4336999999999999e-05 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.929 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:99 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.821607290999999, 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074070849999999999, 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.930 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 99 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.004975+0000", 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1799999999999995e-07 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005039+0000", 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4028000000000004e-05 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005052+0000", 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3063e-05 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005058+0000", 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0050000000000001e-06 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.010001+0000", 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004942915 2024-09-17T16:42:13.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.010071+0000", 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0115000000000002e-05 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012326+0000", 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022541029999999999 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012348+0000", 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2510999999999998e-05 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012382+0000", 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3827e-05 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.935 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:100 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:45.005068+0000", 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 28.821513816, 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074340029999999998, 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 100 2024-09-17T16:42:13.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005068+0000", 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005068+0000", 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005069+0000", 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.13e-07 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005072+0000", 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5669999999999999e-06 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005080+0000", 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2830000000000004e-06 2024-09-17T16:42:13.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.005087+0000", 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6070000000000002e-06 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.011842+0000", 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067547930000000003 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.011896+0000", 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4175999999999998e-05 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012446+0000", 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00054960299999999996 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:13.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012469+0000", 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3210999999999999e-05 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:45.012502+0000", 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3250000000000002e-05 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s2 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:13.941 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.33607798, 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080258499999999993, 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:13.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3899999999999999e-07 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490955+0000", 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045038100000000002 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490970+0000", 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4878000000000001e-05 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490979+0000", 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9340000000000001e-06 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.491052+0000", 2024-09-17T16:42:13.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2410999999999995e-05 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.491062+0000", 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0068000000000001e-05 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498496+0000", 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074337639999999998 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:13.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498530+0000", 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4275e-05 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:13.946 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:13.948 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:13.948 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:13.945+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:14.049 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:14.046+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:14.091 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.091 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:14.091 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:14.091 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.099 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:14.149 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:14.148+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:14.200 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:14.200 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:14.200 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.208 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:14.251 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:14.248+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:14.311 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 39/34 ECSubWrite(tid=10, reqid=client.4553.0:180, at_version=39'7, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:12.471547+0000", 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.8373670849999999, 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0027357919999999999, 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.312 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471547+0000", 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471547+0000", 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471548+0000", 2024-09-17T16:42:14.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2599999999999998e-07 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471667+0000", 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011906 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471681+0000", 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4256999999999999e-05 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471689+0000", 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3049999999999993e-06 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471763+0000", 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3546000000000004e-05 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.471773+0000", 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8109999999999997e-06 2024-09-17T16:42:14.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.474244+0000", 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024710079999999998 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.474283+0000", 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9478999999999999e-05 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.316 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 39/34 ECSubWrite(tid=11, reqid=client.4553.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:12.476133+0000", 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.832781472, 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070900599999999998, 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476133+0000", 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476133+0000", 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476134+0000", 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476148+0000", 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4251e-05 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476165+0000", 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7011999999999999e-05 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476175+0000", 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7550000000000006e-06 2024-09-17T16:42:14.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476237+0000", 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1933999999999994e-05 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476247+0000", 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.577e-06 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476810+0000", 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00056324200000000004 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:12.476842+0000", 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2243999999999998e-05 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.481327+0000", 2024-09-17T16:42:14.321 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.82758736899999996, 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072693339999999997, 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481327+0000", 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481327+0000", 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481328+0000", 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6699999999999999e-07 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481893+0000", 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00056551300000000002 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481906+0000", 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3069e-05 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481916+0000", 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481987+0000", 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0798999999999998e-05 2024-09-17T16:42:14.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482085+0000", 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7386999999999994e-05 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488560+0000", 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064752209999999998 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488597+0000", 2024-09-17T16:42:14.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6724999999999998e-05 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.481401+0000", 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.82751334899999995, 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039947539999999997, 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.326 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481401+0000", 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481401+0000", 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481401+0000", 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8099999999999999e-07 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481438+0000", 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7094000000000001e-05 2024-09-17T16:42:14.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481462+0000", 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3708999999999999e-05 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481473+0000", 2024-09-17T16:42:14.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0733999999999999e-05 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481567+0000", 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3660999999999997e-05 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481577+0000", 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0668e-05 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.485354+0000", 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037763480000000001 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.485396+0000", 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2358999999999999e-05 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:14.331 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.482682+0000", 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.82623231200000002, 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005541987, 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482682+0000", 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482682+0000", 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482683+0000", 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.09e-07 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482704+0000", 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1032000000000001e-05 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482718+0000", 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3868e-05 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482727+0000", 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1770000000000004e-06 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482801+0000", 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3362000000000007e-05 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482809+0000", 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6980000000000004e-06 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488181+0000", 2024-09-17T16:42:14.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0053721480000000002 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488224+0000", 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2793000000000002e-05 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:14.336 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.483486+0000", 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.82542863600000005, 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047641209999999996, 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483486+0000", 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483486+0000", 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483487+0000", 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5900000000000005e-07 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483506+0000", 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8834999999999998e-05 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.338 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483519+0000", 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3648999999999999e-05 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483529+0000", 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3940000000000002e-06 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.339 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.484031+0000", 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050215600000000002 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.484039+0000", 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2260000000000005e-06 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488228+0000", 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041892730000000003 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.340 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488250+0000", 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1628999999999999e-05 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.490295+0000", 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.81861978700000004, 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069721380000000001, 2024-09-17T16:42:14.341 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490295+0000", 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490295+0000", 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.342 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490295+0000", 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2200000000000004e-07 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490735+0000", 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043969000000000001 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490747+0000", 2024-09-17T16:42:14.343 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2011000000000001e-05 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490777+0000", 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9938e-05 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490856+0000", 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9198999999999998e-05 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.344 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490870+0000", 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3458000000000001e-05 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497226+0000", 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0063567880000000004 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497267+0000", 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0531999999999998e-05 2024-09-17T16:42:14.345 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpRead(3.7s1 40/34 ECSubRead(tid=64, to_read={3:edf9cac5:::smithi18337221-37:head=0,151552,0}, subchunks={3:edf9cac5:::smithi18337221-37:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492349+0000", 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.81656531200000004, 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075928300000000003, 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.346 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492349+0000", 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492349+0000", 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.347 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492350+0000", 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3399999999999997e-07 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492362+0000", 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1539000000000001e-05 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492378+0000", 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6277e-05 2024-09-17T16:42:14.348 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492388+0000", 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0015e-05 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492475+0000", 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7144000000000005e-05 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493109+0000", 2024-09-17T16:42:14.349 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00063337400000000002 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.81631873099999996, 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089069189999999993, 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.350 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.351 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492597+0000", 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493106+0000", 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050891100000000002 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493115+0000", 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8079999999999999e-06 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.352 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493123+0000", 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8259999999999993e-06 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493203+0000", 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0124999999999996e-05 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493212+0000", 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8340000000000005e-06 2024-09-17T16:42:14.353 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501463+0000", 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082505530000000007 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501503+0000", 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9965000000000001e-05 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.354 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.497845+0000", 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.81107004100000002, 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010603069999999999, 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497845+0000", 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.355 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497845+0000", 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497846+0000", 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.009e-06 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.356 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497868+0000", 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2069000000000002e-05 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497895+0000", 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7531000000000001e-05 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497904+0000", 2024-09-17T16:42:14.357 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3330000000000003e-06 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497966+0000", 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1896000000000005e-05 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497975+0000", 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2439999999999993e-06 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.358 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498861+0000", 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00088654000000000001 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498905+0000", 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3684999999999999e-05 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.359 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.499845+0000", 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.80906927299999998, 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047138639999999999, 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499845+0000", 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.360 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499845+0000", 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499853+0000", 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8499999999999994e-06 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500027+0000", 2024-09-17T16:42:14.361 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017426599999999999 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500045+0000", 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7210999999999998e-05 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500054+0000", 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1030000000000008e-06 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.362 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500126+0000", 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1843999999999999e-05 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500136+0000", 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.022e-05 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.504530+0000", 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0043938909999999996 2024-09-17T16:42:14.363 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.504559+0000", 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9479e-05 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.501421+0000", 2024-09-17T16:42:14.364 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.807493346, 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040003260000000002, 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501421+0000", 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.365 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501421+0000", 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501422+0000", 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501521+0000", 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8808000000000007e-05 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.366 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501533+0000", 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2211999999999999e-05 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501542+0000", 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0010000000000007e-06 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501631+0000", 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8966000000000002e-05 2024-09-17T16:42:14.367 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501641+0000", 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8090000000000004e-06 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505384+0000", 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003742623 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505422+0000", 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7979999999999999e-05 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 40/34 ECSubWrite(tid=69, reqid=client.4553.0:185, at_version=40'17, trim_to=0'0, roll_forward_to=40'15))", 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.505746+0000", 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.80316845000000003, 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000612329, 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.369 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505746+0000", 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505746+0000", 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505747+0000", 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1299999999999999e-07 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505766+0000", 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9284999999999999e-05 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505777+0000", 2024-09-17T16:42:14.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0793e-05 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505783+0000", 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2500000000000003e-06 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505839+0000", 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5680999999999998e-05 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505848+0000", 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1179999999999998e-06 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506329+0000", 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048132399999999999 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506358+0000", 2024-09-17T16:42:14.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9065e-05 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 40/34 ECSubWrite(tid=15, reqid=client.4553.0:207, at_version=40'13, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.506390+0000", 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.80252407100000001, 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083549700000000004, 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.374 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506390+0000", 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506390+0000", 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506391+0000", 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5499999999999998e-07 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506406+0000", 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5123000000000001e-05 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506415+0000", 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0510000000000002e-06 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506421+0000", 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7960000000000001e-06 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506461+0000", 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9687000000000001e-05 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506466+0000", 2024-09-17T16:42:14.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.485e-06 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507191+0000", 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072466499999999999 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507226+0000", 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5135000000000002e-05 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.378 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=51, reqid=client.4553.0:192, at_version=0'0, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.506585+0000", 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.80233006900000003, 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00088464399999999997, 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506585+0000", 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506585+0000", 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506585+0000", 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9699999999999995e-07 2024-09-17T16:42:14.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506596+0000", 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0638e-05 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506607+0000", 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.147e-05 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506625+0000", 2024-09-17T16:42:14.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7985000000000001e-05 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506678+0000", 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2846999999999997e-05 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506684+0000", 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3909999999999997e-06 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507423+0000", 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073959399999999999 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507469+0000", 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6022000000000001e-05 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.383 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.510660+0000", 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.79825464899999998, 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037846379999999999, 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510660+0000", 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510660+0000", 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510661+0000", 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9999999999999997e-07 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511022+0000", 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036124799999999999 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511033+0000", 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1187e-05 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511041+0000", 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.157e-06 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511101+0000", 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9531999999999999e-05 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511110+0000", 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.037e-06 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.514411+0000", 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033011849999999999 2024-09-17T16:42:14.387 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.514445+0000", 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3692000000000002e-05 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 40/34 ECSubWrite(tid=16, reqid=client.4553.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=40'13))", 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.510827+0000", 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.79808736499999999, 2024-09-17T16:42:14.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00087482300000000005, 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510827+0000", 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510827+0000", 2024-09-17T16:42:14.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510828+0000", 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8999999999999996e-07 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510846+0000", 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7793000000000001e-05 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510857+0000", 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0927999999999999e-05 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510863+0000", 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3799999999999999e-06 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510922+0000", 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8554999999999998e-05 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510930+0000", 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6689999999999995e-06 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511656+0000", 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072584799999999997 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511702+0000", 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.596e-05 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 40/34 ECSubWrite(tid=73, reqid=client.4553.0:197, at_version=40'19, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:14.393 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.512917+0000", 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.795997438, 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021040170000000001, 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.512917+0000", 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.512917+0000", 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.512918+0000", 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8100000000000001e-07 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.513010+0000", 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2167e-05 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.513024+0000", 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3750999999999999e-05 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.513033+0000", 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4320000000000005e-06 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.513087+0000", 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3387000000000002e-05 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.513093+0000", 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7440000000000001e-06 2024-09-17T16:42:14.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.514997+0000", 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019030469999999999 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.515021+0000", 2024-09-17T16:42:14.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4607999999999999e-05 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 40/34 ECSubWrite(tid=74, reqid=client.4553.0:197, at_version=0'0, trim_to=0'0, roll_forward_to=40'19))", 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.516976+0000", 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.79193819499999996, 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00052606699999999996, 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.399 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516976+0000", 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516976+0000", 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516977+0000", 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516985+0000", 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3119999999999994e-06 2024-09-17T16:42:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516993+0000", 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5440000000000001e-06 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516999+0000", 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9719999999999997e-06 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517040+0000", 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0748999999999999e-05 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517045+0000", 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.322e-06 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517470+0000", 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042556400000000002 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517502+0000", 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1949000000000002e-05 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=53, reqid=client.4553.0:187, at_version=0'0, trim_to=0'0, roll_forward_to=40'24))", 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.517122+0000", 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.79179252499999997, 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001509776, 2024-09-17T16:42:14.404 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517122+0000", 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517122+0000", 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517123+0000", 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3399999999999999e-07 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517130+0000", 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2269999999999996e-06 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.406 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517139+0000", 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4560000000000006e-06 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517144+0000", 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8670000000000002e-06 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517199+0000", 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4775000000000003e-05 2024-09-17T16:42:14.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517207+0000", 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3420000000000008e-06 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.518590+0000", 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001382706 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.518632+0000", 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1869000000000002e-05 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.409 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.410 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:14.411 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:14.408+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:14.468 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:42:14.471 INFO:tasks.rados.rados.0.smithi183.stdout:66: done (13 left) 2024-09-17T16:42:14.471 INFO:tasks.rados.rados.0.smithi183.stdout:67: done (12 left) 2024-09-17T16:42:14.471 INFO:tasks.rados.rados.0.smithi183.stdout:68: done (11 left) 2024-09-17T16:42:14.471 INFO:tasks.rados.rados.0.smithi183.stdout:69: done (10 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:70: done (9 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:71: done (8 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:72: done (7 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:73: done (6 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:74: done (5 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:75: done (4 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:76: done (3 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:77: done (2 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:78: done (1 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:79: done (0 left) 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:80: copy_from oid 16 from oid 10 current snap is 3 2024-09-17T16:42:14.472 INFO:tasks.rados.rados.0.smithi183.stdout:81: snap_remove snap 0 2024-09-17T16:42:14.511 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:14.509+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:14.516 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.516 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:14.516 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:14.516 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.525 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:14.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:14.612 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:14.610+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:14.660 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:14.668 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.668 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:14.668 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:14.668 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:14.668 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.676 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:14.679 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:14.679 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:14.697 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:14.697 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:14.714 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:14.714 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:14.720 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:14.718+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:14.730 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:14.730 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:14.748 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:14.748 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:14.767 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.481503+0000", 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.297477408, 2024-09-17T16:42:14.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001840932, 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481503+0000", 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481503+0000", 2024-09-17T16:42:14.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481503+0000", 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-07 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481528+0000", 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4748000000000001e-05 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481540+0000", 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2398000000000001e-05 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481550+0000", 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6339999999999996e-06 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481623+0000", 2024-09-17T16:42:14.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3098999999999999e-05 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481632+0000", 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3030000000000005e-06 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483297+0000", 2024-09-17T16:42:14.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016650969999999999 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483344+0000", 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6343e-05 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:14.786 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.482786+0000", 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2961943119999999, 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002119087, 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482786+0000", 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482786+0000", 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482787+0000", 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9299999999999996e-07 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482893+0000", 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010656 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482909+0000", 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5917999999999999e-05 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482918+0000", 2024-09-17T16:42:14.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9129999999999992e-06 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482986+0000", 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8204e-05 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.482996+0000", 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3330000000000003e-06 2024-09-17T16:42:14.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.484852+0000", 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018566360000000001 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.484905+0000", 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2630000000000003e-05 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.483223+0000", 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2957569929999999, 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049082409999999998, 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483223+0000", 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483223+0000", 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483224+0000", 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.61e-07 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483241+0000", 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7206000000000001e-05 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483253+0000", 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483264+0000", 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599e-05 2024-09-17T16:42:14.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483557+0000", 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000292596 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483566+0000", 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1209999999999996e-06 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488086+0000", 2024-09-17T16:42:14.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045198649999999996 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488131+0000", 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5293000000000002e-05 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:14.796 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2863236929999999, 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067612239999999997, 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492657+0000", 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.066e-06 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493093+0000", 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043573899999999998 2024-09-17T16:42:14.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493113+0000", 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9661999999999999e-05 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493126+0000", 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2778e-05 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493222+0000", 2024-09-17T16:42:14.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6797000000000002e-05 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493232+0000", 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0042e-05 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499374+0000", 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061420320000000004 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499418+0000", 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3108000000000001e-05 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.278641978, 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005312804, 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:14.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2099999999999998e-07 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500563+0000", 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022494799999999999 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0983e-05 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500583+0000", 2024-09-17T16:42:14.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4360000000000002e-06 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500651+0000", 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8580999999999999e-05 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500663+0000", 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.152e-05 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505621+0000", 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049577199999999997 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505651+0000", 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0295e-05 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=51, reqid=client.4553.0:192, at_version=0'0, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.506647+0000", 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.272333425, 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000943252, 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506647+0000", 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506647+0000", 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506648+0000", 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.015e-06 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506921+0000", 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000272878 2024-09-17T16:42:14.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506937+0000", 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6558999999999998e-05 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.506947+0000", 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7189999999999996e-06 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507026+0000", 2024-09-17T16:42:14.809 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8827999999999998e-05 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507036+0000", 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0057999999999999e-05 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507561+0000", 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00052570199999999996 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507590+0000", 2024-09-17T16:42:14.810 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8493e-05 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2682715449999999, 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005690596, 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.811 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:14.812 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5300000000000002e-07 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511000+0000", 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029004500000000001 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511009+0000", 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1989999999999995e-06 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.813 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511015+0000", 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5599999999999999e-06 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511096+0000", 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0453999999999999e-05 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511105+0000", 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:42:14.814 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516357+0000", 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052516070000000001 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516399+0000", 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2267e-05 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.815 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 40/34 ECSubWrite(tid=15, reqid=client.4553.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.510894+0000", 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.2680857649999999, 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068225800000000004, 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.816 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510894+0000", 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510894+0000", 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.817 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510895+0000", 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9800000000000002e-07 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510907+0000", 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2111e-05 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510924+0000", 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6810999999999999e-05 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.818 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510933+0000", 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0080000000000008e-06 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511002+0000", 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8499999999999998e-05 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511011+0000", 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3479999999999993e-06 2024-09-17T16:42:14.819 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511534+0000", 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00052283799999999997 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511577+0000", 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2744000000000003e-05 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.820 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=53, reqid=client.4553.0:187, at_version=0'0, trim_to=0'0, roll_forward_to=40'24))", 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.517126+0000", 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.261854209, 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00051988499999999999, 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.821 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517126+0000", 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517126+0000", 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517127+0000", 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1900000000000001e-07 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.822 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517138+0000", 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1642e-05 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517154+0000", 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5658000000000002e-05 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517163+0000", 2024-09-17T16:42:14.823 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3519999999999996e-06 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517229+0000", 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5847999999999997e-05 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517238+0000", 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7269999999999996e-06 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.824 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517609+0000", 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037128600000000002 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.517646+0000", 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6553000000000001e-05 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.825 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 41/34 ECSubWrite(tid=16, reqid=client.4553.0:221, at_version=41'10, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:14.481665+0000", 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.297314676, 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021320660000000002, 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481665+0000", 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.826 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481665+0000", 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481665+0000", 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1899999999999999e-07 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481750+0000", 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4741999999999996e-05 2024-09-17T16:42:14.827 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481762+0000", 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1286e-05 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481771+0000", 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1570000000000006e-06 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481846+0000", 2024-09-17T16:42:14.828 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5556000000000006e-05 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.481858+0000", 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1822e-05 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.483756+0000", 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00189777 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.829 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.483797+0000", 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1613999999999998e-05 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 41/34 ECSubWrite(tid=17, reqid=client.4553.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=41'10))", 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:14.486001+0000", 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.29297862099999999, 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062200600000000003, 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:14.830 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486001+0000", 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486001+0000", 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:14.831 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486002+0000", 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0699999999999996e-07 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486014+0000", 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1841000000000001e-05 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486025+0000", 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0862e-05 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.832 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486031+0000", 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.677e-06 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486078+0000", 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7089000000000003e-05 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486088+0000", 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0138e-05 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.833 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486586+0000", 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00049852700000000002 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:14.486623+0000", 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7064999999999998e-05 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:14.834 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:14.835 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.835 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:14.835 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:14.835 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-09-17T16:42:14.835 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-09-17T16:42:14.835 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:14.837 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:14.837 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:14.834+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:14.837 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:14.838 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:14.838 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:14.838 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:14.839 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:14.839 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:14.840 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:14.840 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:14.852 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:14.852 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:14.869 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:14.869 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:14.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:14.868+0000 7f104b7fe640 0 -- 172.21.15.60:0/2396988207 >> [v2:172.21.15.98:6816/2084737149,v1:172.21.15.98:6817/2084737149] conn(0x7f104c21bd90 msgr2=0x7f104c21e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:14.937 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:14.935+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:14.981 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:14.981 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:14.981 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:14.981 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:14.989 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:15.038 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:15.036+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:15.089 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:15.089 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:15.091 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:15.091 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:15.091 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:15.091 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:15.092 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:15.100 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:15.106 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:15.106 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:15.123 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:15.123 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:15.138 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:15.139 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:15.141 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:15.138+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:15.151 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-09-17T16:42:15.047386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":24494643,"num_objects":57,"num_object_clones":3,"num_object_copies":379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":200,"num_read_kb":3798,"num_write":242,"num_write_kb":26568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":472052,"kb_used_data":35364,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509477388,"statfs":{"total":1546188226560,"available":1545704845312,"internally_reserved":0,"allocated":36212736,"data_stored":34452205,"data_compressed":434700,"data_compressed_allocated":946176,"data_compressed_original":2797568,"omap_allocated":25521,"internal_metadata":446733391},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23904256,"num_objects":53,"num_object_clones":3,"num_object_copies":371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":124,"num_read_kb":3734,"num_write":117,"num_write_kb":24416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001024"},"pg_stats":[{"pgid":"3.f","version":"37'2","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T16:42:13.467541+0000","last_change":"2024-09-17T16:42:13.467824+0000","last_active":"2024-09-17T16:42:13.467541+0000","last_peered":"2024-09-17T16:42:13.467541+0000","last_clean":"2024-09-17T16:42:13.467541+0000","last_became_active":"2024-09-17T16:42:08.901951+0000","last_became_peered":"2024-09-17T16:42:08.901951+0000","last_unstale":"2024-09-17T16:42:13.467541+0000","last_undegraded":"2024-09-17T16:42:13.467541+0000","last_fullsized":"2024-09-17T16:42:13.467541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.239358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056187800000000003,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,14,11,7,10,0],"acting":[13,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.e","version":"37'8","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.468151+0000","last_change":"2024-09-17T16:42:09.288935+0000","last_active":"2024-09-17T16:42:12.468151+0000","last_peered":"2024-09-17T16:42:12.468151+0000","last_clean":"2024-09-17T16:42:12.468151+0000","last_became_active":"2024-09-17T16:42:09.288377+0000","last_became_peered":"2024-09-17T16:42:09.288377+0000","last_unstale":"2024-09-17T16:42:12.468151+0000","last_undegraded":"2024-09-17T16:42:12.468151+0000","last_fullsized":"2024-09-17T16:42:12.468151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:20.849597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2473984,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":1507,"num_write":8,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,13,8,6,12],"acting":[2,11,5,13,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"37'4","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T16:42:13.467390+0000","last_change":"2024-09-17T16:42:13.467671+0000","last_active":"2024-09-17T16:42:13.467390+0000","last_peered":"2024-09-17T16:42:13.467390+0000","last_clean":"2024-09-17T16:42:13.467390+0000","last_became_active":"2024-09-17T16:42:09.119028+0000","last_became_peered":"2024-09-17T16:42:09.119028+0000","last_unstale":"2024-09-17T16:42:13.467390+0000","last_undegraded":"2024-09-17T16:42:13.467390+0000","last_fullsized":"2024-09-17T16:42:13.467390+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:16.743848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0004528,"stat_sum":{"num_bytes":671744,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,14,10,9,8,4],"acting":[13,1,14,10,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.c","version":"40'24","reported_seq":70,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T16:42:14.483440+0000","last_change":"2024-09-17T16:42:13.483945+0000","last_active":"2024-09-17T16:42:14.483440+0000","last_peered":"2024-09-17T16:42:14.483440+0000","last_clean":"2024-09-17T16:42:14.483440+0000","last_became_active":"2024-09-17T16:42:09.287827+0000","last_became_peered":"2024-09-17T16:42:09.287827+0000","last_unstale":"2024-09-17T16:42:14.483440+0000","last_undegraded":"2024-09-17T16:42:14.483440+0000","last_fullsized":"2024-09-17T16:42:14.483440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.305724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041127760000000003,"stat_sum":{"num_bytes":3751936,"num_objects":10,"num_object_clones":2,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":788,"num_write":21,"num_write_kb":3696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,10,6,12,3],"acting":[5,8,13,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.b","version":"37'13","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.468410+0000","last_change":"2024-09-17T16:42:09.288530+0000","last_active":"2024-09-17T16:42:12.468410+0000","last_peered":"2024-09-17T16:42:12.468410+0000","last_clean":"2024-09-17T16:42:12.468410+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:42:12.468410+0000","last_undegraded":"2024-09-17T16:42:12.468410+0000","last_fullsized":"2024-09-17T16:42:12.468410+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:23.819149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2703360,"num_objects":6,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":6,"num_write":13,"num_write_kb":3328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"37'6","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T16:42:13.482405+0000","last_change":"2024-09-17T16:42:13.467486+0000","last_active":"2024-09-17T16:42:13.482405+0000","last_peered":"2024-09-17T16:42:13.482405+0000","last_clean":"2024-09-17T16:42:13.482405+0000","last_became_active":"2024-09-17T16:42:09.120200+0000","last_became_peered":"2024-09-17T16:42:09.120200+0000","last_unstale":"2024-09-17T16:42:13.482405+0000","last_undegraded":"2024-09-17T16:42:13.482405+0000","last_fullsized":"2024-09-17T16:42:13.482405+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:23.838556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038289200000000002,"stat_sum":{"num_bytes":1425408,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":985,"num_write":6,"num_write_kb":1392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,14,6,10],"acting":[13,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"3.9","version":"37'6","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.539973+0000","last_change":"2024-09-17T16:42:08.904656+0000","last_active":"2024-09-17T16:42:10.539973+0000","last_peered":"2024-09-17T16:42:10.539973+0000","last_clean":"2024-09-17T16:42:10.539973+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:42:10.539973+0000","last_undegraded":"2024-09-17T16:42:10.539973+0000","last_fullsized":"2024-09-17T16:42:10.539973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:10.949985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1196032,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.8","version":"37'5","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.600407+0000","last_change":"2024-09-17T16:42:09.120994+0000","last_active":"2024-09-17T16:42:10.600407+0000","last_peered":"2024-09-17T16:42:10.600407+0000","last_clean":"2024-09-17T16:42:10.600407+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:42:10.600407+0000","last_undegraded":"2024-09-17T16:42:10.600407+0000","last_fullsized":"2024-09-17T16:42:10.600407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:16.108800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1458176,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":5,"num_write_kb":1424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"24'92","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.451797+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:42:10.451797+0000","last_peered":"2024-09-17T16:42:10.451797+0000","last_clean":"2024-09-17T16:42:10.451797+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:42:10.451797+0000","last_undegraded":"2024-09-17T16:42:10.451797+0000","last_fullsized":"2024-09-17T16:42:10.451797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.452265+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:42:10.452265+0000","last_peered":"2024-09-17T16:42:10.452265+0000","last_clean":"2024-09-17T16:42:10.452265+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:42:10.452265+0000","last_undegraded":"2024-09-17T16:42:10.452265+0000","last_fullsized":"2024-09-17T16:42:10.452265+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.452115+0000","last_change":"2024-09-17T16:42:09.120774+0000","last_active":"2024-09-17T16:42:10.452115+0000","last_peered":"2024-09-17T16:42:10.452115+0000","last_clean":"2024-09-17T16:42:10.452115+0000","last_became_active":"2024-09-17T16:42:09.120070+0000","last_became_peered":"2024-09-17T16:42:09.120070+0000","last_unstale":"2024-09-17T16:42:10.452115+0000","last_undegraded":"2024-09-17T16:42:10.452115+0000","last_fullsized":"2024-09-17T16:42:10.452115+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:11.679075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,13,1,5,3,7],"acting":[11,2,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.811290+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:42:12.811290+0000","last_peered":"2024-09-17T16:42:12.811290+0000","last_clean":"2024-09-17T16:42:12.811290+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:42:12.811290+0000","last_undegraded":"2024-09-17T16:42:12.811290+0000","last_fullsized":"2024-09-17T16:42:12.811290+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"37'11","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.468219+0000","last_change":"2024-09-17T16:42:08.903007+0000","last_active":"2024-09-17T16:42:12.468219+0000","last_peered":"2024-09-17T16:42:12.468219+0000","last_clean":"2024-09-17T16:42:12.468219+0000","last_became_active":"2024-09-17T16:42:08.902123+0000","last_became_peered":"2024-09-17T16:42:08.902123+0000","last_unstale":"2024-09-17T16:42:12.468219+0000","last_undegraded":"2024-09-17T16:42:12.468219+0000","last_fullsized":"2024-09-17T16:42:12.468219+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:33.111272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":421,"num_write":11,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,3,11,10,2,7],"acting":[4,13,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.470323+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:42:10.470323+0000","last_peered":"2024-09-17T16:42:10.470323+0000","last_clean":"2024-09-17T16:42:10.470323+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:42:10.470323+0000","last_undegraded":"2024-09-17T16:42:10.470323+0000","last_fullsized":"2024-09-17T16:42:10.470323+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"37'5","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.590112+0000","last_change":"2024-09-17T16:42:08.818169+0000","last_active":"2024-09-17T16:42:10.590112+0000","last_peered":"2024-09-17T16:42:10.590112+0000","last_clean":"2024-09-17T16:42:10.590112+0000","last_became_active":"2024-09-17T16:42:08.817399+0000","last_became_peered":"2024-09-17T16:42:08.817399+0000","last_unstale":"2024-09-17T16:42:10.590112+0000","last_undegraded":"2024-09-17T16:42:10.590112+0000","last_fullsized":"2024-09-17T16:42:10.590112+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:18.590530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":901120,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":5,"num_write_kb":880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,13,11,4],"acting":[14,2,9,3,13,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T16:42:13.467097+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:42:13.467097+0000","last_peered":"2024-09-17T16:42:13.467097+0000","last_clean":"2024-09-17T16:42:13.467097+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:42:13.467097+0000","last_undegraded":"2024-09-17T16:42:13.467097+0000","last_fullsized":"2024-09-17T16:42:13.467097+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"37'6","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.635085+0000","last_change":"2024-09-17T16:42:08.902324+0000","last_active":"2024-09-17T16:42:10.635085+0000","last_peered":"2024-09-17T16:42:10.635085+0000","last_clean":"2024-09-17T16:42:10.635085+0000","last_became_active":"2024-09-17T16:42:08.901463+0000","last_became_peered":"2024-09-17T16:42:08.901463+0000","last_unstale":"2024-09-17T16:42:10.635085+0000","last_undegraded":"2024-09-17T16:42:10.635085+0000","last_fullsized":"2024-09-17T16:42:10.635085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:29.127601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,13,2,10,5],"acting":[15,9,4,13,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.5","version":"37'8","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-17T16:42:14.483440+0000","last_change":"2024-09-17T16:42:13.480726+0000","last_active":"2024-09-17T16:42:14.483440+0000","last_peered":"2024-09-17T16:42:14.483440+0000","last_clean":"2024-09-17T16:42:14.483440+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:42:14.483440+0000","last_undegraded":"2024-09-17T16:42:14.483440+0000","last_fullsized":"2024-09-17T16:42:14.483440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:15.024293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010015919999999999,"stat_sum":{"num_bytes":1114112,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":8,"num_write_kb":1440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.469166+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:42:12.469166+0000","last_peered":"2024-09-17T16:42:12.469166+0000","last_clean":"2024-09-17T16:42:12.469166+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:42:12.469166+0000","last_undegraded":"2024-09-17T16:42:12.469166+0000","last_fullsized":"2024-09-17T16:42:12.469166+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"39'11","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.468961+0000","last_change":"2024-09-17T16:42:08.819071+0000","last_active":"2024-09-17T16:42:12.468961+0000","last_peered":"2024-09-17T16:42:12.468961+0000","last_clean":"2024-09-17T16:42:12.468961+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:42:12.468961+0000","last_undegraded":"2024-09-17T16:42:12.468961+0000","last_fullsized":"2024-09-17T16:42:12.468961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.916284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":10,"num_write_kb":1824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-17T16:42:10.468513+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:42:10.468513+0000","last_peered":"2024-09-17T16:42:10.468513+0000","last_clean":"2024-09-17T16:42:10.468513+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:42:10.468513+0000","last_undegraded":"2024-09-17T16:42:10.468513+0000","last_fullsized":"2024-09-17T16:42:10.468513+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"37'6","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.468156+0000","last_change":"2024-09-17T16:42:08.914930+0000","last_active":"2024-09-17T16:42:12.468156+0000","last_peered":"2024-09-17T16:42:12.468156+0000","last_clean":"2024-09-17T16:42:12.468156+0000","last_became_active":"2024-09-17T16:42:08.914114+0000","last_became_peered":"2024-09-17T16:42:08.914114+0000","last_unstale":"2024-09-17T16:42:12.468156+0000","last_undegraded":"2024-09-17T16:42:12.468156+0000","last_fullsized":"2024-09-17T16:42:12.468156+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:36.242760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,13],"acting":[4,6,7,0,11,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.458280+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:42:12.458280+0000","last_peered":"2024-09-17T16:42:12.458280+0000","last_clean":"2024-09-17T16:42:12.458280+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:42:12.458280+0000","last_undegraded":"2024-09-17T16:42:12.458280+0000","last_fullsized":"2024-09-17T16:42:12.458280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"37'6","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-17T16:42:12.463753+0000","last_change":"2024-09-17T16:42:08.902842+0000","last_active":"2024-09-17T16:42:12.463753+0000","last_peered":"2024-09-17T16:42:12.463753+0000","last_clean":"2024-09-17T16:42:12.463753+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:42:12.463753+0000","last_undegraded":"2024-09-17T16:42:12.463753+0000","last_fullsized":"2024-09-17T16:42:12.463753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:19.584394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-17T16:42:13.467211+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:42:13.467211+0000","last_peered":"2024-09-17T16:42:13.467211+0000","last_clean":"2024-09-17T16:42:13.467211+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:42:13.467211+0000","last_undegraded":"2024-09-17T16:42:13.467211+0000","last_fullsized":"2024-09-17T16:42:13.467211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":23904256,"num_objects":53,"num_object_clones":3,"num_object_copies":371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":124,"num_read_kb":3734,"num_write":117,"num_write_kb":24416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40673280,"data_stored":40968192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182410,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29012,"kb_used_data":1984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342828,"statfs":{"total":96636764160,"available":96607055872,"internally_reserved":0,"allocated":2031616,"data_stored":1854319,"data_compressed":25428,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182410,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29348,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342492,"statfs":{"total":96636764160,"available":96606711808,"internally_reserved":0,"allocated":2367488,"data_stored":2190191,"data_compressed":25428,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182410,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31220,"kb_used_data":4192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340620,"statfs":{"total":96636764160,"available":96604794880,"internally_reserved":0,"allocated":4292608,"data_stored":4603279,"data_compressed":32699,"data_compressed_allocated":86016,"data_compressed_original":630784,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280520,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29632,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342208,"statfs":{"total":96636764160,"available":96606420992,"internally_reserved":0,"allocated":2662400,"data_stored":2483028,"data_compressed":27444,"data_compressed_allocated":57344,"data_compressed_original":114688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280520,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30716,"kb_used_data":3680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341124,"statfs":{"total":96636764160,"available":96605310976,"internally_reserved":0,"allocated":3768320,"data_stored":3582796,"data_compressed":29461,"data_compressed_allocated":61440,"data_compressed_original":122880,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280520,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30120,"kb_used_data":3088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341720,"statfs":{"total":96636764160,"available":96605921280,"internally_reserved":0,"allocated":3162112,"data_stored":3458420,"data_compressed":33896,"data_compressed_allocated":90112,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280520,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30272,"kb_used_data":3240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341568,"statfs":{"total":96636764160,"available":96605765632,"internally_reserved":0,"allocated":3317760,"data_stored":3138388,"data_compressed":27444,"data_compressed_allocated":57344,"data_compressed_original":114688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313225,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29868,"kb_used_data":2836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341972,"statfs":{"total":96636764160,"available":96606179328,"internally_reserved":0,"allocated":2904064,"data_stored":2722617,"data_compressed":29461,"data_compressed_allocated":61440,"data_compressed_original":122880,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313225,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28636,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343204,"statfs":{"total":96636764160,"available":96607440896,"internally_reserved":0,"allocated":1638400,"data_stored":1459028,"data_compressed":27444,"data_compressed_allocated":57344,"data_compressed_original":114688,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247818,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30540,"kb_used_data":3508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341300,"statfs":{"total":96636764160,"available":96605491200,"internally_reserved":0,"allocated":3592192,"data_stored":3543922,"data_compressed":31479,"data_compressed_allocated":65536,"data_compressed_original":131072,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215111,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":193418,"data_compressed":23415,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215114,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":193418,"data_compressed":23415,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":368640,"data_stored":193418,"data_compressed":23415,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215113,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":372736,"data_stored":193437,"data_compressed":23415,"data_compressed_allocated":49152,"data_compressed_original":98304,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182410,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29288,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342552,"statfs":{"total":96636764160,"available":96606773248,"internally_reserved":0,"allocated":2310144,"data_stored":2132847,"data_compressed":25428,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182408,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29652,"kb_used_data":2624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342188,"statfs":{"total":96636764160,"available":96606400512,"internally_reserved":0,"allocated":2686976,"data_stored":2509679,"data_compressed":25428,"data_compressed_allocated":53248,"data_compressed_original":106496,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1564672,"data_stored":1564672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2805760,"data_stored":2805760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1929216,"data_stored":1929216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2977792,"data_stored":2977792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3215360,"data_stored":3350528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3280896,"data_stored":3280896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2306048,"data_stored":2306048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":2498560,"data_stored":2498560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":1245184,"data_stored":1245184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":3076096,"data_stored":3076096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":3870720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":2330624,"data_stored":2330624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":3629056,"data_stored":3788800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":1986560,"data_stored":1986560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":1650688,"data_stored":1650688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:15.153 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-09-17T16:42:15.242 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:15.240+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:15.242 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.242 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.251 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:15.343 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:15.342+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:15.366 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.366 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.376 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:15.445 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:15.442+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:15.478 INFO:tasks.rados.rados.0.smithi183.stdout:81: done (1 left) 2024-09-17T16:42:15.478 INFO:tasks.rados.rados.0.smithi183.stdout:82: snap_remove snap 2 2024-09-17T16:42:15.479 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.479 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.487 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:15.546 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:15.544+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:15.590 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.591 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.599 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:15.646 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:15.644+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:15.703 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.703 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.711 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:15.748 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:15.746+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:15.849 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:15.846+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:15.858 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.858 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.868 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:15.950 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:15.947+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:15.970 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:15.971 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:15.980 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:16.050 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:16.047+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:16.082 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.083 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.091 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:16.151 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:16.149+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:16.194 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.194 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.202 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:16.252 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:16.250+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:16.304 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.304 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.313 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:16.352 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:16.350+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:16.414 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.415 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.423 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:16.468 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:16.465+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:16.483 INFO:tasks.rados.rados.0.smithi183.stdout:82: done (1 left) 2024-09-17T16:42:16.483 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 13 current snap is 3 2024-09-17T16:42:16.484 INFO:tasks.rados.rados.0.smithi183.stdout:83: seq_num 55 ranges {212992=557056,770048=376832} 2024-09-17T16:42:16.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:42:16.488 INFO:tasks.rados.rados.0.smithi183.stdout:83: writing smithi18337221-13 from 212992 to 770048 tid 1 2024-09-17T16:42:16.490 INFO:tasks.rados.rados.0.smithi183.stdout:83: writing smithi18337221-13 from 770048 to 1146880 tid 2 2024-09-17T16:42:16.491 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 4 current snap is 3 2024-09-17T16:42:16.491 INFO:tasks.rados.rados.0.smithi183.stdout:80: finishing copy_from racing read to smithi18337221-16 2024-09-17T16:42:16.491 INFO:tasks.rados.rados.0.smithi183.stdout:84: seq_num 56 ranges {65536=573440,638976=376832} 2024-09-17T16:42:16.494 INFO:tasks.rados.rados.0.smithi183.stdout:84: writing smithi18337221-4 from 65536 to 638976 tid 1 2024-09-17T16:42:16.497 INFO:tasks.rados.rados.0.smithi183.stdout:84: writing smithi18337221-4 from 638976 to 1015808 tid 2 2024-09-17T16:42:16.497 INFO:tasks.rados.rados.0.smithi183.stdout:85: rmattr oid 47 current snap is 3 2024-09-17T16:42:16.497 INFO:tasks.rados.rados.0.smithi183.stdout:85: done (3 left) 2024-09-17T16:42:16.497 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 15 current snap is 3 2024-09-17T16:42:16.497 INFO:tasks.rados.rados.0.smithi183.stdout:86: seq_num 57 ranges {245760=589824,835584=376832} 2024-09-17T16:42:16.503 INFO:tasks.rados.rados.0.smithi183.stdout:86: writing smithi18337221-15 from 245760 to 835584 tid 1 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:86: writing smithi18337221-15 from 835584 to 1212416 tid 2 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:87: read oid 30 snap -1 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:87: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:88: copy_from oid 32 from oid 12 current snap is 3 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:80: finishing copy_from to smithi18337221-16 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 16 v 2 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:83: finishing write tid 1 to smithi18337221-13 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:83: finishing write tid 2 to smithi18337221-13 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:80: done (5 left) 2024-09-17T16:42:16.506 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 3 current snap is 3 2024-09-17T16:42:16.507 INFO:tasks.rados.rados.0.smithi183.stdout:89: seq_num 58 ranges {49152=606208,655360=376832} 2024-09-17T16:42:16.509 INFO:tasks.rados.rados.0.smithi183.stdout:89: writing smithi18337221-3 from 49152 to 655360 tid 1 2024-09-17T16:42:16.512 INFO:tasks.rados.rados.0.smithi183.stdout:89: writing smithi18337221-3 from 655360 to 1032192 tid 2 2024-09-17T16:42:16.512 INFO:tasks.rados.rados.0.smithi183.stdout:90: snap_create 2024-09-17T16:42:16.513 INFO:tasks.rados.rados.0.smithi183.stdout:83: finishing write tid 3 to smithi18337221-13 2024-09-17T16:42:16.513 INFO:tasks.rados.rados.0.smithi183.stdout:87: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:16.513 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:16.521 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:16.530 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 462538 2024-09-17T16:42:16.531 INFO:tasks.rados.rados.0.smithi183.stdout:83: finishing write tid 4 to smithi18337221-13 2024-09-17T16:42:16.531 INFO:tasks.rados.rados.0.smithi183.stdout:83: oid 13 updating version 0 to 17 2024-09-17T16:42:16.531 INFO:tasks.rados.rados.0.smithi183.stdout:83: oid 13 version 17 is already newer than 16 2024-09-17T16:42:16.531 INFO:tasks.rados.rados.0.smithi183.stdout:83: oid 13 version 17 is already newer than 15 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 13 v 17 (ObjNum 55 snap 3 seq_num 55) dirty exists 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:83: left oid 13 (ObjNum 55 snap 3 seq_num 55) 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:84: finishing write tid 1 to smithi18337221-4 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:84: finishing write tid 2 to smithi18337221-4 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:84: finishing write tid 3 to smithi18337221-4 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:88: finishing copy_from racing read to smithi18337221-32 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:89: finishing write tid 1 to smithi18337221-3 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:86: finishing write tid 1 to smithi18337221-15 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:89: finishing write tid 2 to smithi18337221-3 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:86: finishing write tid 2 to smithi18337221-15 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:88: finishing copy_from to smithi18337221-32 2024-09-17T16:42:16.532 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 32 v 4 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:84: finishing write tid 4 to smithi18337221-4 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:84: oid 4 updating version 0 to 9 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:84: oid 4 version 9 is already newer than 8 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:84: oid 4 version 9 is already newer than 7 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 4 v 9 (ObjNum 56 snap 3 seq_num 56) dirty exists 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:84: left oid 4 (ObjNum 56 snap 3 seq_num 56) 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:86: finishing write tid 3 to smithi18337221-15 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:89: finishing write tid 3 to smithi18337221-3 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:86: finishing write tid 4 to smithi18337221-15 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:86: oid 15 updating version 0 to 12 2024-09-17T16:42:16.533 INFO:tasks.rados.rados.0.smithi183.stdout:86: oid 15 version 12 is already newer than 11 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:86: oid 15 version 12 is already newer than 10 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 12 (ObjNum 57 snap 3 seq_num 57) dirty exists 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:86: left oid 15 (ObjNum 57 snap 3 seq_num 57) 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:89: finishing write tid 4 to smithi18337221-3 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:89: oid 3 updating version 0 to 7 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:89: oid 3 updating version 7 to 10 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:89: oid 3 version 10 is already newer than 8 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 3 v 10 (ObjNum 58 snap 3 seq_num 58) dirty exists 2024-09-17T16:42:16.534 INFO:tasks.rados.rados.0.smithi183.stdout:89: left oid 3 (ObjNum 58 snap 3 seq_num 58) 2024-09-17T16:42:16.541 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.541 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.550 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:16.555 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:16.553+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:16.655 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:16.653+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:16.696 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.696 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:16.757 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:16.754+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:16.812 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.813 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.821 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:16.857 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:16.854+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:16.929 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:16.929 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:16.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:16.958 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:16.955+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:17.045 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:17.045 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:17.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:17.059 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:17.056+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:17.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:17.160 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:17.157+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:17.163 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:17.163 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:17.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:17.261 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:17.259+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:17.262 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:17.262 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:17.280 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:17.280 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:17.299 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:17.299 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:17.317 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:17.317 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:17.322 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:17.323 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:17.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:17.333 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:17.333 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:17.350 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:17.350 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:17.361 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:17.359+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:17.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:17.368 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:17.384 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:17.384 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:17.401 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:17.401 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:17.418 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:17.436 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:17.436 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:17.442 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:17.442 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9641386929999998, 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:17.443 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:42:17.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:42:17.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.96220594, 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.450 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:42:17.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:17.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:42:17.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9617789490000002, 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:17.457 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:42:17.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:42:17.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9617454849999998, 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:42:17.464 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:42:17.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:42:17.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:17.471 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.961699179, 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:42:17.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:42:17.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9616393260000002, 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.479 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:42:17.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.485 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.5.23:2 3.bs0 3:d08ffbb6:::smithi18337221-30:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9563688849999998, 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025206989999999999, 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483332+0000", 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9630000000000001e-06 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483339+0000", 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483351+0000", 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483359+0000", 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506020+0000", 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022660777 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506121+0000", 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010158999999999999 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508537+0000", 2024-09-17T16:42:17.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002415848 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9517087179999999, 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016316462, 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487992+0000", 2024-09-17T16:42:17.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1400000000000001e-06 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487999+0000", 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1459999999999999e-06 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488012+0000", 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3499000000000001e-05 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488021+0000", 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6519999999999995e-06 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504215+0000", 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016193754000000001 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504307+0000", 2024-09-17T16:42:17.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2270999999999998e-05 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9509583990000001, 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01555453, 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488742+0000", 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7899999999999997e-07 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488747+0000", 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3759999999999999e-06 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488766+0000", 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8739000000000001e-05 2024-09-17T16:42:17.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488775+0000", 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1889999999999996e-06 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504279+0000", 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015503576 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504295+0000", 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6770999999999999e-05 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.950874335, 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015687293000000001, 2024-09-17T16:42:17.498 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488826+0000", 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488829+0000", 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9589999999999997e-06 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488839+0000", 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6840000000000008e-06 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488845+0000", 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504490+0000", 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015645032 2024-09-17T16:42:17.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504512+0000", 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1790999999999999e-05 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.489903+0000", 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9497959040000001, 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014554675, 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489903+0000", 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489903+0000", 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489905+0000", 2024-09-17T16:42:17.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.266e-06 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489912+0000", 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9739999999999996e-06 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489926+0000", 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4256999999999999e-05 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489934+0000", 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.551e-06 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504428+0000", 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014493259 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504458+0000", 2024-09-17T16:42:17.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0368000000000001e-05 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:211 3.1s0 3:8551e558:::smithi18337221-41:head [read 443262~244866,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.489981+0000", 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9497185539999999, 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012068693, 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.507 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 211 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489981+0000", 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489981+0000", 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489982+0000", 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.818e-06 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489989+0000", 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8759999999999999e-06 2024-09-17T16:42:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490006+0000", 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6592e-05 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490013+0000", 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.182e-06 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490082+0000", 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8443999999999997e-05 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490182+0000", 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100441 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502049+0000", 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011867340000000001 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:212 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9490956740000001, 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014567019, 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 212 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490605+0000", 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.074e-06 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490610+0000", 2024-09-17T16:42:17.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8370000000000002e-06 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490626+0000", 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.571e-05 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490645+0000", 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8952000000000001e-05 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490964+0000", 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031921400000000001 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491049+0000", 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4197999999999996e-05 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505171+0000", 2024-09-17T16:42:17.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014122034 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:213 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9490391730000001, 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017648329000000001, 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.517 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 213 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490661+0000", 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490665+0000", 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1010000000000002e-06 2024-09-17T16:42:17.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490675+0000", 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0467e-05 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490681+0000", 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8939999999999998e-06 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492163+0000", 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001481794 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492244+0000", 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0897999999999997e-05 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508308+0000", 2024-09-17T16:42:17.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016064544 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:214 3.7s0 3:edf9cac5:::smithi18337221-37:2 [read 0~606208,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490772+0000", 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9489270740000002, 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0067281909999999997, 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.522 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 214 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490772+0000", 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490772+0000", 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490773+0000", 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0499999999999999e-06 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490779+0000", 2024-09-17T16:42:17.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0360000000000003e-06 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490794+0000", 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5221e-05 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490801+0000", 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9619999999999996e-06 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490870+0000", 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8839999999999998e-05 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490987+0000", 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000116816 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497500+0000", 2024-09-17T16:42:17.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065132660000000002 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:215 3.7s0 3:edf9cac5:::smithi18337221-37:2 [read 485330~120878,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.491660+0000", 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.948039181, 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0062183789999999996, 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.527 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 215 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491660+0000", 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491660+0000", 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491661+0000", 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0389999999999999e-06 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491667+0000", 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0979999999999999e-06 2024-09-17T16:42:17.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491680+0000", 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2591e-05 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491688+0000", 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0739999999999993e-06 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492612+0000", 2024-09-17T16:42:17.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00092405799999999995 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492694+0000", 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2132999999999994e-05 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497878+0000", 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005184386 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:216 3.7s0 3:edf9cac5:::smithi18337221-37:2 [read 0~606208,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.947990656, 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068160599999999997, 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.532 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 216 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9699999999999995e-07 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491716+0000", 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1890000000000001e-06 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.534 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491730+0000", 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3526000000000001e-05 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491737+0000", 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6390000000000003e-06 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013769539999999999 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493193+0000", 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9714000000000003e-05 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498525+0000", 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053313409999999999 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 39/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.494015+0000", 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9456842540000001, 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010569123999999999, 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494015+0000", 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494015+0000", 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494016+0000", 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7199999999999997e-07 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494021+0000", 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0019999999999997e-06 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494032+0000", 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1620999999999999e-05 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494041+0000", 2024-09-17T16:42:17.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4400000000000005e-06 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504559+0000", 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010517761 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504584+0000", 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5428000000000001e-05 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9426944280000003, 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078633430000000001, 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3099999999999997e-07 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497011+0000", 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2079999999999999e-06 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497022+0000", 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1721e-05 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497038+0000", 2024-09-17T16:42:17.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6004000000000001e-05 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504650+0000", 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076114149999999998 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504868+0000", 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000218264 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=71, last_complete=40'17, committed=1, applied=1))", 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.511785+0000", 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.9279146740000002, 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042364400000000002, 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511785+0000", 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511785+0000", 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511785+0000", 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0999999999999997e-07 2024-09-17T16:42:17.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511791+0000", 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3600000000000004e-06 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511808+0000", 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6923e-05 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511816+0000", 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.011e-06 2024-09-17T16:42:17.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516003+0000", 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041876429999999996 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516021+0000", 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7592999999999999e-05 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.548 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.549 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:17.550 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:17.547+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:17.550 INFO:tasks.rados.rados.0.smithi183.stdout:83: done (6 left) 2024-09-17T16:42:17.550 INFO:tasks.rados.rados.0.smithi183.stdout:84: done (5 left) 2024-09-17T16:42:17.550 INFO:tasks.rados.rados.0.smithi183.stdout:86: done (4 left) 2024-09-17T16:42:17.551 INFO:tasks.rados.rados.0.smithi183.stdout:87: done (3 left) 2024-09-17T16:42:17.551 INFO:tasks.rados.rados.0.smithi183.stdout:88: done (2 left) 2024-09-17T16:42:17.551 INFO:tasks.rados.rados.0.smithi183.stdout:89: done (1 left) 2024-09-17T16:42:17.551 INFO:tasks.rados.rados.0.smithi183.stdout:90: done (0 left) 2024-09-17T16:42:17.551 INFO:tasks.rados.rados.0.smithi183.stdout:91: snap_remove snap 3 2024-09-17T16:42:17.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:17.552 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:17.553 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:42:17.553 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:17.555 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:17.518+0000 7f00fe938640 0 -- 172.21.15.60:0/1084740293 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f00f8222070 msgr2=0x7f00f8224460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:17.555 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:17.556 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:17.651 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:17.648+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:17.700 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:17.700 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:17.700 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:17.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:17.752 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:17.749+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:17.816 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:17.816 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:17.816 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:17.816 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:17.816 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:17.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:17.853 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:17.850+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:17.933 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.933 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:178 3.4s0 3:216603c8:::smithi18337221-7:head [copy-from ver 2] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 5.4700103110000002, 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0097627789999999992, 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 178 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460520+0000", 2024-09-17T16:42:17.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3209999999999999e-06 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460526+0000", 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4590000000000003e-06 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460539+0000", 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2634e-05 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460546+0000", 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0450000000000003e-06 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460588+0000", 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1984999999999999e-05 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460652+0000", 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4475999999999997e-05 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.466465+0000", 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058132269999999998 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469088+0000", 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026224709999999999 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470220+0000", 2024-09-17T16:42:17.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001132248 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470281+0000", 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0912999999999998e-05 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:179 3.4s0 3:216603c8:::smithi18337221-7:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 5.4699702070000003, 2024-09-17T16:42:17.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084466430000000002, 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 179 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460559+0000", 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6800000000000001e-07 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460562+0000", 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5410000000000001e-06 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460569+0000", 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2160000000000003e-06 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460576+0000", 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1230000000000002e-06 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460781+0000", 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00020571599999999999 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460810+0000", 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8632999999999998e-05 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468798+0000", 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0079879180000000001 2024-09-17T16:42:17.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468900+0000", 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000101611 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469005+0000", 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105417 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:199 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 764485~497083,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4527144569999999, 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010265850999999999, 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 199 2024-09-17T16:42:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477816+0000", 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8530000000000001e-06 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477825+0000", 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8850000000000005e-06 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477841+0000", 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6070999999999999e-05 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477851+0000", 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0261999999999999e-05 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477947+0000", 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5457000000000004e-05 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:17.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477956+0000", 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9639999999999992e-06 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480792+0000", 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028365840000000001 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480879+0000", 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7130000000000001e-05 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488080+0000", 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072006450000000003 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:200 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4526492050000002, 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011662507000000001, 2024-09-17T16:42:17.950 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 200 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477880+0000", 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8599999999999998e-07 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477886+0000", 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5740000000000001e-06 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477906+0000", 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9604000000000001e-05 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477914+0000", 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5859999999999999e-06 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478028+0000", 2024-09-17T16:42:17.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011431500000000001 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478034+0000", 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0530000000000003e-06 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481597+0000", 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035624699999999999 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481685+0000", 2024-09-17T16:42:17.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8129999999999998e-05 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489542+0000", 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078571890000000005 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:201 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:17.955 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4525995399999996, 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013839093, 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 201 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477930+0000", 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:42:17.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1189999999999999e-06 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477949+0000", 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1701e-05 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477955+0000", 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6529999999999997e-06 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121858 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478083+0000", 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7150000000000003e-06 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482035+0000", 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039517290000000002 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482114+0000", 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9499000000000006e-05 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491768+0000", 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096540259999999996 2024-09-17T16:42:17.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4489411460000001, 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082527759999999999, 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481588+0000", 2024-09-17T16:42:17.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.41e-07 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481637+0000", 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9536999999999997e-05 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481649+0000", 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1718e-05 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481658+0000", 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0589999999999992e-06 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482410+0000", 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00075179700000000001 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482422+0000", 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1980999999999999e-05 2024-09-17T16:42:17.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489809+0000", 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073877420000000001 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489840+0000", 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0701000000000003e-05 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.4s0 40/34 ECSubRead(tid=20, to_read={3:2affd2d4:::smithi18337221-25:head=0,315392,0}, subchunks={3:2affd2d4:::smithi18337221-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4485782030000003, 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041210780000000002, 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484083+0000", 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0021322260000000001 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484095+0000", 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2067e-05 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484953+0000", 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00085798099999999996 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486071+0000", 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011188039999999999 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.4s0 40/34 ECSubRead(tid=21, to_read={3:2affd2d4:::smithi18337221-25:head=0,315392,0}, subchunks={3:2affd2d4:::smithi18337221-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4481937409999999, 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040410029999999996, 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:17.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484140+0000", 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018050950000000001 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484171+0000", 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1547000000000001e-05 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486269+0000", 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0020975120000000002 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486376+0000", 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010684900000000001 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.973 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4477710659999996, 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071068959999999997, 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482758+0000", 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482780+0000", 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1294e-05 2024-09-17T16:42:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482790+0000", 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0736e-05 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482801+0000", 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0474e-05 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482990+0000", 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00018943399999999999 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483000+0000", 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4259999999999992e-06 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489844+0000", 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068445470000000003 2024-09-17T16:42:17.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489864+0000", 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9993999999999999e-05 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=19, attrs_read=0))", 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4477567149999997, 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053380830000000004, 2024-09-17T16:42:17.978 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484196+0000", 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014242460000000001 2024-09-17T16:42:17.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484201+0000", 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3489999999999999e-06 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487501+0000", 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0032999800000000001 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488110+0000", 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00060850800000000001 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4473282029999996, 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066866139999999996, 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.982 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483201+0000", 2024-09-17T16:42:17.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1090000000000001e-06 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483218+0000", 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6175999999999999e-05 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483230+0000", 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2149e-05 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483236+0000", 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4740000000000002e-06 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483520+0000", 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028360700000000001 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483531+0000", 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489867+0000", 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063354129999999998 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489887+0000", 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0285e-05 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=20, attrs_read=0))", 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.484329+0000", 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4461995180000002, 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003057831, 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484329+0000", 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484329+0000", 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484330+0000", 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5599999999999995e-07 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484586+0000", 2024-09-17T16:42:17.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00025627199999999999 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484598+0000", 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2306e-05 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484605+0000", 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4489999999999996e-06 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486466+0000", 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018610740000000001 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487387+0000", 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00092117399999999997 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.990 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4459110070000003, 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036275449999999998, 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.82e-07 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484865+0000", 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00024668800000000001 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484874+0000", 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9819999999999997e-06 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484879+0000", 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5629999999999999e-06 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488201+0000", 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033221190000000001 2024-09-17T16:42:17.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488245+0000", 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3711000000000002e-05 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 39/34 ECSubReadReply(tid=20, attrs_read=0))", 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.485986+0000", 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4445429020000002, 2024-09-17T16:42:17.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024124760000000002, 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485986+0000", 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485986+0000", 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485987+0000", 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0300000000000001e-06 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486443+0000", 2024-09-17T16:42:17.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045644499999999998 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486461+0000", 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7700999999999999e-05 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486469+0000", 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7640000000000005e-06 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:17.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488351+0000", 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018820499999999999 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488398+0000", 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7485999999999999e-05 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:17.998 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4441657580000005, 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033720019999999998, 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:17.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486383+0000", 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.978e-05 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486389+0000", 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2709999999999998e-06 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489692+0000", 2024-09-17T16:42:18.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033035220000000001 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489735+0000", 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2429000000000003e-05 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 39/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.486487+0000", 2024-09-17T16:42:18.002 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.444041189, 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053116750000000001, 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486487+0000", 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486487+0000", 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486488+0000", 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7899999999999999e-07 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489932+0000", 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034442090000000002 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489961+0000", 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9081000000000002e-05 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489970+0000", 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7590000000000003e-06 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490022+0000", 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1820999999999997e-05 2024-09-17T16:42:18.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491799+0000", 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0017773260000000001 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 39/34 ECSubReadReply(tid=20, attrs_read=0))", 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.486765+0000", 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4437630410000004, 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028078529999999999, 2024-09-17T16:42:18.006 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486765+0000", 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486765+0000", 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486766+0000", 2024-09-17T16:42:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6199999999999998e-07 2024-09-17T16:42:18.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487199+0000", 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000432855 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487211+0000", 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1652e-05 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487225+0000", 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.419e-05 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488469+0000", 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012445659999999999 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489573+0000", 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001104028 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 39/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.487243+0000", 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4432856860000003, 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0025598909999999999, 2024-09-17T16:42:18.011 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487243+0000", 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487243+0000", 2024-09-17T16:42:18.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487243+0000", 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5299999999999999e-07 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487528+0000", 2024-09-17T16:42:18.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000284581 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487538+0000", 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.004e-05 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487544+0000", 2024-09-17T16:42:18.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.161e-06 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489761+0000", 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022170359999999999 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489803+0000", 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1619999999999998e-05 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4371406569999996, 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096456860000000005, 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493389+0000", 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.057e-06 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495399+0000", 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002010529 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495410+0000", 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0983e-05 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495418+0000", 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0120000000000005e-06 2024-09-17T16:42:18.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495585+0000", 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000166274 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495592+0000", 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5580000000000003e-06 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502976+0000", 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073836580000000004 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503034+0000", 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7615000000000003e-05 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.510782+0000", 2024-09-17T16:42:18.020 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4197466700000003, 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0050245639999999996, 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510782+0000", 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510782+0000", 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510783+0000", 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.446e-06 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511133+0000", 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034976799999999998 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511155+0000", 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1929e-05 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511167+0000", 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1549000000000001e-05 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511264+0000", 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7739999999999996e-05 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511275+0000", 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1077000000000001e-05 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515755+0000", 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044798540000000001 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515806+0000", 2024-09-17T16:42:18.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1201e-05 2024-09-17T16:42:18.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.025 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:18.026 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:18.027 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:18.024+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:18.127 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:18.125+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:18.134 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:18.134 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:18.134 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:18.134 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:18.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:18.228 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:18.225+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:18.249 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:18.249 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:18.250 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:18.250 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:18.250 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:18.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:18.329 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:18.326+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(client.4353.0:5 2.2 e29/27 2:5cea7035:::rbd_info:head v 29'1, mlcod=0'0)", 2024-09-17T16:42:18.366 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:41:56.117452+0000", 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.246303586, 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001091339, 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117452+0000", 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117452+0000", 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117452+0000", 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.11e-07 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117460+0000", 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2799999999999998e-06 2024-09-17T16:42:18.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117475+0000", 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5756999999999998e-05 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117486+0000", 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0271e-05 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117562+0000", 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5799999999999999e-05 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.117586+0000", 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.482e-05 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.118502+0000", 2024-09-17T16:42:18.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00091524300000000005 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:56.118544+0000", 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1956999999999998e-05 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_repop(client.4353.0:7 2.2 e30/27 2:5cea7035:::rbd_info:head v 30'2, mlcod=0'0)", 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:41:57.129882+0000", 2024-09-17T16:42:18.371 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.233874266000001, 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00096113999999999998, 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.129882+0000", 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.129882+0000", 2024-09-17T16:42:18.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.129882+0000", 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5400000000000001e-07 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.129921+0000", 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9103999999999997e-05 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.129940+0000", 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9021e-05 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.129952+0000", 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1758e-05 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.130022+0000", 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9618999999999999e-05 2024-09-17T16:42:18.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.130046+0000", 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4484000000000001e-05 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.130792+0000", 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00074641300000000002 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:41:57.130843+0000", 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0186999999999999e-05 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482024+0000", 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8817316279999998, 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036145840000000001, 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.376 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482024+0000", 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482024+0000", 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482025+0000", 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.06e-07 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482062+0000", 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6922000000000003e-05 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482072+0000", 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.058e-05 2024-09-17T16:42:18.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482083+0000", 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0849000000000001e-05 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482183+0000", 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010000099999999999 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482195+0000", 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2105e-05 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485599+0000", 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003403583 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485639+0000", 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9938000000000003e-05 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8814213259999999, 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011223067999999999, 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499999999999999e-07 2024-09-17T16:42:18.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482482+0000", 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014705100000000001 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482496+0000", 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4164e-05 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482513+0000", 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6529e-05 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482631+0000", 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011836999999999999 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482642+0000", 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0895e-05 2024-09-17T16:42:18.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493489+0000", 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010846876 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493558+0000", 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8827999999999999e-05 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482909+0000", 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8808467589999998, 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041496379999999998, 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482909+0000", 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482909+0000", 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482910+0000", 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5000000000000001e-07 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482933+0000", 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2628000000000001e-05 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482947+0000", 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4565e-05 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483005+0000", 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7831000000000002e-05 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484904+0000", 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001899328 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484916+0000", 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2011000000000001e-05 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487016+0000", 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0020999669999999999 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487059+0000", 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2357999999999997e-05 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.390 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.484687+0000", 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.879068996, 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023990270000000002, 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484687+0000", 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484687+0000", 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484688+0000", 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2699999999999999e-07 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484713+0000", 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5607000000000001e-05 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484736+0000", 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2609e-05 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484748+0000", 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.199e-05 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485395+0000", 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00064757699999999998 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.485404+0000", 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4139999999999994e-06 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487065+0000", 2024-09-17T16:42:18.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0016612809999999999 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487086+0000", 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0822000000000002e-05 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.86893406, 2024-09-17T16:42:18.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082916329999999996, 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:18.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494823+0000", 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.201e-06 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495212+0000", 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038936199999999998 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495232+0000", 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9830000000000002e-05 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495243+0000", 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0589e-05 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495340+0000", 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6824999999999995e-05 2024-09-17T16:42:18.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495350+0000", 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0778000000000001e-05 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503052+0000", 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077014559999999998 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503113+0000", 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1592000000000003e-05 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.501427+0000", 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8623291039999996, 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0050050909999999997, 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501427+0000", 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501427+0000", 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501428+0000", 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6109999999999999e-06 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501499+0000", 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0449000000000003e-05 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501522+0000", 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3209000000000001e-05 2024-09-17T16:42:18.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501547+0000", 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4579999999999998e-05 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501698+0000", 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015181299999999999 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501710+0000", 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1464000000000001e-05 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506157+0000", 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044470940000000004 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506432+0000", 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027487099999999999 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=69, reqid=client.4553.0:185, at_version=40'17, trim_to=0'0, roll_forward_to=40'15))", 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.505786+0000", 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8579700299999997, 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00138046, 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505786+0000", 2024-09-17T16:42:18.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505786+0000", 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505787+0000", 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0279999999999999e-06 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505811+0000", 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4043999999999999e-05 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505827+0000", 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5868000000000001e-05 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505836+0000", 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7780000000000002e-06 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505926+0000", 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9920000000000006e-05 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505937+0000", 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0638999999999999e-05 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507089+0000", 2024-09-17T16:42:18.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011518209999999999 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507166+0000", 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7361999999999996e-05 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.bs3 40/34 ECSubRead(tid=70, to_read={3:d08ffbb6:::smithi18337221-30:head=0,122880,0}, subchunks={3:d08ffbb6:::smithi18337221-30:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8572248670000002, 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045801899999999999, 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506532+0000", 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3799999999999996e-07 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506542+0000", 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.063e-05 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506555+0000", 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3084999999999999e-05 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506567+0000", 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1464999999999999e-05 2024-09-17T16:42:18.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506672+0000", 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104959 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506989+0000", 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031714200000000002 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=51, reqid=client.4553.0:192, at_version=0'0, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.506616+0000", 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8571399770000001, 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00092712199999999995, 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506616+0000", 2024-09-17T16:42:18.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506616+0000", 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506617+0000", 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2200000000000002e-07 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506631+0000", 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4134999999999999e-05 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506644+0000", 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3077e-05 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506656+0000", 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2044e-05 2024-09-17T16:42:18.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506744+0000", 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8465000000000001e-05 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506754+0000", 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5829999999999996e-06 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507505+0000", 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00075060399999999998 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507543+0000", 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8291999999999999e-05 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=71, reqid=client.4553.0:185, at_version=0'0, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.509120+0000", 2024-09-17T16:42:18.418 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8546353270000004, 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00096145900000000001, 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509120+0000", 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509120+0000", 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509122+0000", 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.127e-06 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509151+0000", 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9130999999999999e-05 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509218+0000", 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6801e-05 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509260+0000", 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2656e-05 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:42:18.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014329499999999999 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509413+0000", 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2599999999999994e-06 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510044+0000", 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00063139499999999998 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510082+0000", 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7793999999999998e-05 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.511074+0000", 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8526815929999998, 2024-09-17T16:42:18.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005749049, 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511074+0000", 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511074+0000", 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511075+0000", 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5600000000000004e-07 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511168+0000", 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2995e-05 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511186+0000", 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8094e-05 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511196+0000", 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.38e-06 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511260+0000", 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4209999999999997e-05 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511273+0000", 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3055e-05 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516796+0000", 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055226729999999996 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516823+0000", 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7685999999999999e-05 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=73, reqid=client.4553.0:197, at_version=40'19, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.512957+0000", 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8507984359999998, 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035445049999999999, 2024-09-17T16:42:18.428 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512957+0000", 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512957+0000", 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512958+0000", 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.096e-06 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.513041+0000", 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2212999999999994e-05 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.513059+0000", 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8462999999999999e-05 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.513070+0000", 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0642000000000001e-05 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.513160+0000", 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0551999999999996e-05 2024-09-17T16:42:18.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.513170+0000", 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516465+0000", 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0032952350000000001 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516502+0000", 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7076000000000002e-05 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=74, reqid=client.4553.0:197, at_version=0'0, trim_to=0'0, roll_forward_to=40'19))", 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.517030+0000", 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8467260410000002, 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011656360000000001, 2024-09-17T16:42:18.433 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517030+0000", 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517030+0000", 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517031+0000", 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.144e-06 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517044+0000", 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3013999999999999e-05 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517106+0000", 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2435999999999996e-05 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517127+0000", 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0829999999999999e-05 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517207+0000", 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9584000000000002e-05 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517216+0000", 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5810000000000003e-06 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.518168+0000", 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00095152500000000005 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.518195+0000", 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7521999999999998e-05 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=53, reqid=client.4553.0:187, at_version=0'0, trim_to=0'0, roll_forward_to=40'24))", 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.517146+0000", 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.8466093539999999, 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00077898300000000002, 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.438 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517146+0000", 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517146+0000", 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517147+0000", 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1800000000000005e-07 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517159+0000", 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1399e-05 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517171+0000", 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2123000000000001e-05 2024-09-17T16:42:18.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517179+0000", 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2500000000000006e-06 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517257+0000", 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8269999999999994e-05 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517270+0000", 2024-09-17T16:42:18.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2588999999999999e-05 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517878+0000", 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000607812 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.517925+0000", 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7722000000000002e-05 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.bs3 41/34 ECSubRead(tid=75, to_read={3:db6a3e40:::smithi18337221-10:head=0,40960,0}, subchunks={3:db6a3e40:::smithi18337221-10:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.478970+0000", 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.8847858180000001, 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00036630499999999998, 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.478970+0000", 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.478970+0000", 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.478970+0000", 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4400000000000001e-07 2024-09-17T16:42:18.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.478980+0000", 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3980000000000005e-06 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.479005+0000", 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5449999999999999e-05 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.479019+0000", 2024-09-17T16:42:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.346e-05 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.479102+0000", 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3844999999999994e-05 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.479336+0000", 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023390800000000001 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:18.447 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:18.447 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:18.448 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:18.449 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:18.446+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:18.501 INFO:tasks.rados.rados.0.smithi183.stdout:91: done (0 left) 2024-09-17T16:42:18.501 INFO:tasks.rados.rados.0.smithi183.stdout:92: read oid 39 snap -1 2024-09-17T16:42:18.501 INFO:tasks.rados.rados.0.smithi183.stdout:92: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-17T16:42:18.501 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 19 current snap is 4 2024-09-17T16:42:18.501 INFO:tasks.rados.rados.0.smithi183.stdout:93: seq_num 59 ranges {311296=622592,933888=376832} 2024-09-17T16:42:18.505 INFO:tasks.rados.rados.0.smithi183.stdout:93: writing smithi18337221-19 from 311296 to 933888 tid 1 2024-09-17T16:42:18.508 INFO:tasks.rados.rados.0.smithi183.stdout:93: writing smithi18337221-19 from 933888 to 1310720 tid 2 2024-09-17T16:42:18.508 INFO:tasks.rados.rados.0.smithi183.stdout:94: rollback oid 9 current snap is 4 2024-09-17T16:42:18.508 INFO:tasks.rados.rados.0.smithi183.stdout:94: done (2 left) 2024-09-17T16:42:18.508 INFO:tasks.rados.rados.0.smithi183.stdout:95: read oid 1 snap -1 2024-09-17T16:42:18.508 INFO:tasks.rados.rados.0.smithi183.stdout:95: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:18.508 INFO:tasks.rados.rados.0.smithi183.stdout:96: snap_create 2024-09-17T16:42:18.510 INFO:tasks.rados.rados.0.smithi183.stdout:92: expect (ObjNum 38 snap 0 seq_num 38) 2024-09-17T16:42:18.510 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:18.519 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 255213 2024-09-17T16:42:18.523 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 85634 2024-09-17T16:42:18.528 INFO:tasks.rados.rados.0.smithi183.stdout:93: finishing write tid 1 to smithi18337221-19 2024-09-17T16:42:18.528 INFO:tasks.rados.rados.0.smithi183.stdout:95: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:18.528 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:18.533 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:18.537 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: finishing write tid 2 to smithi18337221-19 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: finishing write tid 3 to smithi18337221-19 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: finishing write tid 4 to smithi18337221-19 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: oid 19 updating version 0 to 9 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: oid 19 version 9 is already newer than 7 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: oid 19 version 9 is already newer than 8 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 19 v 9 (ObjNum 59 snap 4 seq_num 59) dirty exists 2024-09-17T16:42:18.542 INFO:tasks.rados.rados.0.smithi183.stdout:93: left oid 19 (ObjNum 59 snap 4 seq_num 59) 2024-09-17T16:42:18.548 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:18.545+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:18.571 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:18.571 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:18.571 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:18.580 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:18.650 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:18.647+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:18.725 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:18.725 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:18.725 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:18.734 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:18.750 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:18.748+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:18.837 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:18.838 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 39/34 ECSubWrite(tid=10, reqid=client.4553.0:180, at_version=39'7, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:12.471609+0000", 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3632124450000003, 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001671861, 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.839 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471609+0000", 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471609+0000", 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471609+0000", 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5800000000000001e-07 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471690+0000", 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1543000000000002e-05 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471701+0000", 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0231000000000001e-05 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471710+0000", 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3360000000000001e-06 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471773+0000", 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3291000000000001e-05 2024-09-17T16:42:18.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.471781+0000", 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7980000000000006e-06 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.473252+0000", 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014706739999999999 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.473281+0000", 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.883e-05 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 39/34 ECSubWrite(tid=11, reqid=client.4553.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:12.476096+0000", 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3587256569999999, 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061514399999999998, 2024-09-17T16:42:18.844 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476096+0000", 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476096+0000", 2024-09-17T16:42:18.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476096+0000", 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6699999999999999e-07 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476103+0000", 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7530000000000004e-06 2024-09-17T16:42:18.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476111+0000", 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1389999999999995e-06 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476118+0000", 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7399999999999998e-06 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476188+0000", 2024-09-17T16:42:18.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0419000000000005e-05 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476194+0000", 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.319e-06 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476681+0000", 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048677600000000002 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:12.476711+0000", 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9530999999999999e-05 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.as1 40/34 ECSubRead(tid=25, to_read={3:5b2a661d:::smithi18337221-31:head=98304,28672,0}, subchunks={3:5b2a661d:::smithi18337221-31:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.478444+0000", 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3563774090000003, 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00045655899999999999, 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.849 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478444+0000", 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478444+0000", 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478444+0000", 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9299999999999999e-07 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478454+0000", 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0091999999999999e-05 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478466+0000", 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1601e-05 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478476+0000", 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.024e-05 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478559+0000", 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3171999999999996e-05 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478900+0000", 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034126099999999998 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.as1 40/34 ECSubRead(tid=26, to_read={3:5b2a661d:::smithi18337221-31:head=0,126976,0}, subchunks={3:5b2a661d:::smithi18337221-31:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:18.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.478803+0000", 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3560181939999998, 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064394699999999997, 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478803+0000", 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478803+0000", 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478804+0000", 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3300000000000002e-07 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478810+0000", 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7179999999999999e-06 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478821+0000", 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0951999999999999e-05 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478831+0000", 2024-09-17T16:42:18.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.91e-06 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478931+0000", 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9660000000000005e-05 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479447+0000", 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00051617399999999999 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.as1 40/34 ECSubRead(tid=27, to_read={3:5b2a661d:::smithi18337221-31:head=24576,102400,0}, subchunks={3:5b2a661d:::smithi18337221-31:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.479059+0000", 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3557623410000001, 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052856300000000001, 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479059+0000", 2024-09-17T16:42:18.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479059+0000", 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479059+0000", 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3399999999999999e-07 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479066+0000", 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6109999999999999e-06 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479077+0000", 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1464999999999999e-05 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479087+0000", 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4800000000000007e-06 2024-09-17T16:42:18.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479487+0000", 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040053499999999999 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.479587+0000", 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9938000000000004e-05 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3537591630000003, 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057823329999999997, 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481063+0000", 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6600000000000002e-07 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481326+0000", 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026390499999999999 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481342+0000", 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5136e-05 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481349+0000", 2024-09-17T16:42:18.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8469999999999996e-06 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481426+0000", 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6297000000000005e-05 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481435+0000", 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0289999999999994e-06 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.486818+0000", 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053832089999999999 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.486844+0000", 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6444e-05 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:18.866 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3441882769999998, 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012796989999999999, 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3699999999999999e-07 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492041+0000", 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014080290000000001 2024-09-17T16:42:18.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492061+0000", 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9678e-05 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492070+0000", 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4050000000000006e-06 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492139+0000", 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8300000000000007e-05 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492148+0000", 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7049999999999994e-06 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503396+0000", 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011248081 2024-09-17T16:42:18.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503430+0000", 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3555e-05 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.as1 40/34 ECSubRead(tid=28, to_read={3:53f17c76:::smithi18337221-27:head=0,110592,0}, subchunks={3:53f17c76:::smithi18337221-27:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.492039+0000", 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3427825249999996, 2024-09-17T16:42:18.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078708399999999996, 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492039+0000", 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492039+0000", 2024-09-17T16:42:18.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492040+0000", 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.08e-06 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492048+0000", 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2830000000000001e-06 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492065+0000", 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7088e-05 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492075+0000", 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7929999999999992e-06 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492139+0000", 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4349000000000003e-05 2024-09-17T16:42:18.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492826+0000", 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00068649100000000001 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3370545189999996, 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078697639999999996, 2024-09-17T16:42:18.875 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:18.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8100000000000002e-07 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497784+0000", 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497795+0000", 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0983e-05 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497803+0000", 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2209999999999997e-06 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497860+0000", 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6886999999999999e-05 2024-09-17T16:42:18.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497870+0000", 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0091999999999999e-05 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505602+0000", 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077316379999999999 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505636+0000", 2024-09-17T16:42:18.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4677e-05 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3358625340000003, 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069241900000000002, 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.880 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4700000000000001e-07 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499112+0000", 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015267500000000001 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499122+0000", 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0473e-05 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499130+0000", 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1799999999999999e-06 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499180+0000", 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0114999999999997e-05 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499186+0000", 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5169999999999996e-06 2024-09-17T16:42:18.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505852+0000", 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066659800000000002 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505883+0000", 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3351484999999998, 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059870100000000001, 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:18.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499973+0000", 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029958099999999999 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499984+0000", 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.08e-05 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499992+0000", 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5210000000000002e-06 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500153+0000", 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016087299999999999 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500161+0000", 2024-09-17T16:42:18.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1170000000000004e-06 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505641+0000", 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054796269999999999 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505660+0000", 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8989999999999999e-05 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=69, reqid=client.4553.0:185, at_version=40'17, trim_to=0'0, roll_forward_to=40'15))", 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.505569+0000", 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3292523789999997, 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012838000000000001, 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505569+0000", 2024-09-17T16:42:18.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505569+0000", 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505570+0000", 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.09e-07 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505590+0000", 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0696e-05 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505602+0000", 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1533e-05 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505610+0000", 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8809999999999996e-06 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505675+0000", 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5165000000000004e-05 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505684+0000", 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4020000000000008e-06 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506821+0000", 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001136745 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506853+0000", 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1569000000000002e-05 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=15, reqid=client.4553.0:207, at_version=40'13, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.506410+0000", 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3284108330000004, 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003283514, 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506410+0000", 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506410+0000", 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506411+0000", 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1999999999999998e-07 2024-09-17T16:42:18.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506428+0000", 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6685e-05 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506446+0000", 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8247e-05 2024-09-17T16:42:18.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506455+0000", 2024-09-17T16:42:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8699999999999998e-06 2024-09-17T16:42:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506502+0000", 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.651e-05 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506508+0000", 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.161e-06 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509663+0000", 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031549450000000001 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509694+0000", 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1275999999999997e-05 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=71, reqid=client.4553.0:185, at_version=0'0, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.509173+0000", 2024-09-17T16:42:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3256480819999998, 2024-09-17T16:42:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032112960000000002, 2024-09-17T16:42:18.903 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509173+0000", 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509173+0000", 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509174+0000", 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3200000000000005e-07 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509182+0000", 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7150000000000004e-06 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509193+0000", 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0285000000000001e-05 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509198+0000", 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1449999999999999e-06 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509249+0000", 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1431999999999998e-05 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509257+0000", 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4730000000000003e-06 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512350+0000", 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030936919999999999 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512384+0000", 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3921999999999998e-05 2024-09-17T16:42:18.908 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=16, reqid=client.4553.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=40'13))", 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3240435389999998, 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042977600000000003, 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.909 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5600000000000005e-07 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510786+0000", 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6890000000000004e-06 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510796+0000", 2024-09-17T16:42:18.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8409999999999995e-06 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510804+0000", 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5450000000000003e-06 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510859+0000", 2024-09-17T16:42:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4209000000000002e-05 2024-09-17T16:42:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510869+0000", 2024-09-17T16:42:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0108999999999999e-05 2024-09-17T16:42:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515046+0000", 2024-09-17T16:42:18.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041771589999999997 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515075+0000", 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9552000000000001e-05 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=73, reqid=client.4553.0:197, at_version=40'19, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.512836+0000", 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3219856070000002, 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025163899999999999, 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.917 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512836+0000", 2024-09-17T16:42:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512836+0000", 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512836+0000", 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.44e-07 2024-09-17T16:42:18.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512921+0000", 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4787e-05 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512930+0000", 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4870000000000008e-06 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512936+0000", 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2959999999999998e-06 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512989+0000", 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3443000000000003e-05 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512999+0000", 2024-09-17T16:42:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:42:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515329+0000", 2024-09-17T16:42:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023303629999999998 2024-09-17T16:42:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515352+0000", 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2959000000000002e-05 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=74, reqid=client.4553.0:197, at_version=0'0, trim_to=0'0, roll_forward_to=40'19))", 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.516960+0000", 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3178616420000004, 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00073466199999999997, 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:18.924 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516960+0000", 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516960+0000", 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516960+0000", 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2300000000000001e-07 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516968+0000", 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4139999999999994e-06 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516978+0000", 2024-09-17T16:42:18.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6630000000000005e-06 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516983+0000", 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8629999999999999e-06 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.517032+0000", 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9443000000000001e-05 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:18.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.517042+0000", 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5699999999999999e-06 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.517661+0000", 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061847599999999997 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.517694+0000", 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3710000000000001e-05 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.929 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:18.930 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:18.930 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:18.931 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:18.932 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:18.929+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:19.032 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:19.030+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:19.035 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:19.035 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:19.035 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.044 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:19.133 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:19.130+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:19.147 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:19.147 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:19.147 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.157 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:19.235 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:19.232+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:19.261 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:19.261 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:187 3.cs0 3:385cb74d:::smithi18337221-1:head [copy-from ver 8] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7807967629999997, 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.039364976000000003, 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 187 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477631+0000", 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477644+0000", 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2748999999999999e-05 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477673+0000", 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8603e-05 2024-09-17T16:42:19.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477688+0000", 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5454000000000001e-05 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477843+0000", 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015473799999999999 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:19.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8953e-05 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480146+0000", 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022843439999999998 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480220+0000", 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3986999999999995e-05 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510626+0000", 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030406048000000001 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515100+0000", 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044740450000000003 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:19.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516938+0000", 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001837736 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516994+0000", 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6045000000000003e-05 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:188 3.cs0 3:385cb74d:::smithi18337221-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.268 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7806907909999996, 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.036238998000000001, 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 188 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477736+0000", 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.494e-06 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477742+0000", 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8930000000000002e-06 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477763+0000", 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0942999999999999e-05 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477781+0000", 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7479999999999999e-05 2024-09-17T16:42:19.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019260600000000001 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477980+0000", 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4829999999999996e-06 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480439+0000", 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024594259999999998 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480480+0000", 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0512000000000001e-05 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513848+0000", 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033368666999999998 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513906+0000", 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513974+0000", 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8291000000000001e-05 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:189 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477805+0000", 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7806209979999998, 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012842599, 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 189 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477805+0000", 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477805+0000", 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477806+0000", 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.15e-06 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477811+0000", 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2530000000000004e-06 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477828+0000", 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7283e-05 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477842+0000", 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3337e-05 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478019+0000", 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017758300000000001 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478023+0000", 2024-09-17T16:42:19.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2610000000000002e-06 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480513+0000", 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024901680000000001 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480572+0000", 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9490999999999997e-05 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481392+0000", 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082016599999999999 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483656+0000", 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022633929999999998 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490571+0000", 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069147260000000004 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490647+0000", 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6787999999999997e-05 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:190 3.cs0 3:3f892186:::smithi18337221-33:head [rollback 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477860+0000", 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7805655590000002, 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012958247000000001, 2024-09-17T16:42:19.281 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 190 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477860+0000", 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477860+0000", 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477861+0000", 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2999999999999999e-07 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477866+0000", 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0969999999999996e-06 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477897+0000", 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0783e-05 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477922+0000", 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4666999999999999e-05 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478055+0000", 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013373700000000001 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478062+0000", 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481914+0000", 2024-09-17T16:42:19.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038522199999999999 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481963+0000", 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9237999999999999e-05 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047424099999999997 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483971+0000", 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015334610000000001 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490781+0000", 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068098000000000004 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490818+0000", 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7659e-05 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.287 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:191 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7804970930000001, 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020837920999999999, 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.288 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 191 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477932+0000", 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2389999999999998e-06 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477939+0000", 2024-09-17T16:42:19.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8530000000000003e-06 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477944+0000", 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3279999999999999e-06 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478088+0000", 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014464 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478091+0000", 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6900000000000001e-06 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482685+0000", 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045939370000000002 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482783+0000", 2024-09-17T16:42:19.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8634000000000005e-05 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483160+0000", 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000376645 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.484086+0000", 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000926092 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498688+0000", 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014601930000000001 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498767+0000", 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8502000000000002e-05 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.294 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:192 3.cs0 3:3e21370b:::smithi18337221-11:head [copy-from ver 6] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7804631239999997, 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028471962999999999, 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 192 2024-09-17T16:42:19.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999999e-07 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477966+0000", 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0769999999999999e-06 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5239999999999997e-06 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477976+0000", 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2399999999999999e-06 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478121+0000", 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145038 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478126+0000", 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4480000000000002e-06 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483386+0000", 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052599209999999999 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483472+0000", 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6159e-05 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492564+0000", 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090913120000000007 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.501360+0000", 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008796313 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506376+0000", 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050161659999999999 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506435+0000", 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8354999999999999e-05 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:193 3.cs0 3:3e21370b:::smithi18337221-11:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7804440440000002, 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020602901, 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 193 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.302 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:19.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477983+0000", 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3909999999999999e-06 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477992+0000", 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5669999999999995e-06 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477995+0000", 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9119999999999998e-06 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478149+0000", 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153695 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478153+0000", 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5990000000000004e-06 2024-09-17T16:42:19.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483619+0000", 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054658809999999997 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483650+0000", 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1115999999999998e-05 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498397+0000", 2024-09-17T16:42:19.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014746853000000001 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498485+0000", 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8203999999999998e-05 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9411000000000001e-05 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.307 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWriteReply(3.cs0 40/34 ECSubWriteReply(tid=49, last_complete=40'21, committed=1, applied=1))", 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.491313+0000", 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7671124220000003, 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074679339999999999, 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.491313+0000", 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.491313+0000", 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.491314+0000", 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9100000000000004e-07 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.491317+0000", 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3629999999999998e-06 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.491324+0000", 2024-09-17T16:42:19.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1080000000000004e-06 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.491332+0000", 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9389999999999997e-06 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498620+0000", 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072879470000000003 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498781+0000", 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016098600000000001 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s3 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499595+0000", 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7588307570000001, 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072031780000000002, 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.312 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499595+0000", 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499595+0000", 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499595+0000", 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.65e-07 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499856+0000", 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026118499999999999 2024-09-17T16:42:19.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499867+0000", 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0447e-05 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499874+0000", 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0160000000000003e-06 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499935+0000", 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1515999999999999e-05 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499945+0000", 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2199999999999998e-06 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506770+0000", 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068251639999999999 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506798+0000", 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8365e-05 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:255 3.cs0 3:385cb74d:::smithi18337221-1:head [read 0~491520,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.507365+0000", 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75106066500000002, 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0092398629999999992, 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 255 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.318 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507365+0000", 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507365+0000", 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507367+0000", 2024-09-17T16:42:19.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9980000000000002e-06 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507377+0000", 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9709999999999999e-06 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507402+0000", 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4698999999999998e-05 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507411+0000", 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.662e-06 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507495+0000", 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.373e-05 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507502+0000", 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9779999999999999e-06 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510095+0000", 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025932899999999998 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510156+0000", 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0098e-05 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516605+0000", 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064494369999999997 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:256 3.cs0 3:385cb74d:::smithi18337221-1:head [read 0~491520,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.507454+0000", 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75097130899999998, 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095184299999999996, 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 256 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507454+0000", 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507454+0000", 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507455+0000", 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1900000000000002e-07 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507471+0000", 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6152999999999999e-05 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507483+0000", 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1416999999999999e-05 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507490+0000", 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507581+0000", 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0445000000000006e-05 2024-09-17T16:42:19.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507587+0000", 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9329999999999998e-06 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510562+0000", 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029748520000000001 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510645+0000", 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3003999999999993e-05 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516973+0000", 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063282729999999997 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:257 3.cs0 3:385cb74d:::smithi18337221-1:head [read 0~491520,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.507505+0000", 2024-09-17T16:42:19.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75092106999999997, 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010790006, 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 257 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507505+0000", 2024-09-17T16:42:19.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507505+0000", 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507505+0000", 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8500000000000001e-07 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507509+0000", 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5140000000000002e-06 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507515+0000", 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3339999999999998e-06 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507520+0000", 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8470000000000003e-06 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507610+0000", 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0167999999999995e-05 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507613+0000", 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1540000000000002e-06 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.517016+0000", 2024-09-17T16:42:19.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094029479999999995 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.517072+0000", 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5293000000000001e-05 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.518295+0000", 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001223163 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.9s4 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.508233+0000", 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75019311300000002, 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091505709999999997, 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508233+0000", 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508233+0000", 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508233+0000", 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6800000000000001e-07 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508647+0000", 2024-09-17T16:42:19.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041364100000000002 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508657+0000", 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9720000000000004e-06 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508669+0000", 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2394e-05 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508745+0000", 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5964000000000007e-05 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508756+0000", 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0722e-05 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.517343+0000", 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085872339999999991 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.517383+0000", 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0275999999999999e-05 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.cs0 45/34 ECSubRead(tid=57, to_read={3:385cb74d:::smithi18337221-1:head=0,122880,0}, subchunks={3:385cb74d:::smithi18337221-1:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.510357+0000", 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74806873200000001, 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054887169999999997, 2024-09-17T16:42:19.338 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510357+0000", 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510357+0000", 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510357+0000", 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510357+0000", 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510373+0000", 2024-09-17T16:42:19.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5498999999999998e-05 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510385+0000", 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2578999999999999e-05 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511031+0000", 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064547300000000003 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.515846+0000", 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048151660000000001 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpRead(3.cs0 45/34 ECSubRead(tid=58, to_read={3:385cb74d:::smithi18337221-1:head=0,122880,0}, subchunks={3:385cb74d:::smithi18337221-1:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.510834+0000", 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74759135600000004, 2024-09-17T16:42:19.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051609480000000003, 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510834+0000", 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510834+0000", 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510834+0000", 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510834+0000", 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510855+0000", 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0602e-05 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.510864+0000", 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3260000000000002e-06 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.515885+0000", 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050204840000000004 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.515995+0000", 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000110536 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpReadReply(3.cs0 45/34 ECSubReadReply(tid=57, attrs_read=0))", 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.511064+0000", 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74736164800000005, 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050005689999999998, 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511064+0000", 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511064+0000", 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511065+0000", 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2600000000000002e-07 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511278+0000", 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000213177 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511288+0000", 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6819999999999998e-06 2024-09-17T16:42:19.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511296+0000", 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7889999999999995e-06 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516021+0000", 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047254050000000002 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516065+0000", 2024-09-17T16:42:19.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3789999999999999e-05 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpReadReply(3.cs0 45/34 ECSubReadReply(tid=58, attrs_read=0))", 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.511307+0000", 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74711829799999996, 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048123970000000004, 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511307+0000", 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511307+0000", 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511308+0000", 2024-09-17T16:42:19.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2599999999999998e-07 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511396+0000", 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8491000000000004e-05 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511404+0000", 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6249999999999998e-06 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511408+0000", 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6899999999999998e-06 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516096+0000", 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046881420000000002 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516120+0000", 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4122999999999999e-05 2024-09-17T16:42:19.353 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpReadReply(3.cs0 45/34 ECSubReadReply(tid=57, attrs_read=0))", 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.511404+0000", 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74702138900000004, 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047621399999999998, 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511404+0000", 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511404+0000", 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511405+0000", 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0279999999999999e-06 2024-09-17T16:42:19.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511651+0000", 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024603599999999999 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511662+0000", 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0351e-05 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511668+0000", 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4309999999999999e-06 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516147+0000", 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044783239999999997 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516167+0000", 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.997e-05 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.357 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpReadReply(3.cs0 45/34 ECSubReadReply(tid=58, attrs_read=0))", 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.511682+0000", 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74674373999999999, 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045232650000000003, 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511682+0000", 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511682+0000", 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511682+0000", 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4499999999999997e-07 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511802+0000", 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000119298 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511812+0000", 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0212e-05 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.511818+0000", 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8749999999999997e-06 2024-09-17T16:42:19.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516186+0000", 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043679629999999999 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.516205+0000", 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9471999999999999e-05 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.9s4 45/34 ECSubWrite(tid=31, reqid=client.4553.0:252, at_version=45'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.514613+0000", 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.74381323200000005, 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069999399999999996, 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514613+0000", 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514613+0000", 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514613+0000", 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.54e-07 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514867+0000", 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025336800000000002 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514877+0000", 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0614e-05 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514884+0000", 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.489e-06 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514938+0000", 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4060000000000001e-05 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.514946+0000", 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2430000000000005e-06 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.521586+0000", 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066398459999999996 2024-09-17T16:42:19.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.521612+0000", 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6565999999999999e-05 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.366 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:19.368 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:19.365+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:19.469 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:19.467+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:19.471 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.471 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:19.471 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:19.471 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.480 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:19.502 INFO:tasks.rados.rados.0.smithi183.stdout:92: done (3 left) 2024-09-17T16:42:19.503 INFO:tasks.rados.rados.0.smithi183.stdout:93: done (2 left) 2024-09-17T16:42:19.503 INFO:tasks.rados.rados.0.smithi183.stdout:95: done (1 left) 2024-09-17T16:42:19.503 INFO:tasks.rados.rados.0.smithi183.stdout:96: done (0 left) 2024-09-17T16:42:19.503 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 29 current snap is 5 2024-09-17T16:42:19.503 INFO:tasks.rados.rados.0.smithi183.stdout:97: seq_num 60 ranges {475136=638976,1114112=376832} 2024-09-17T16:42:19.508 INFO:tasks.rados.rados.0.smithi183.stdout:97: writing smithi18337221-29 from 475136 to 1114112 tid 1 2024-09-17T16:42:19.510 INFO:tasks.rados.rados.0.smithi183.stdout:97: writing smithi18337221-29 from 1114112 to 1490944 tid 2 2024-09-17T16:42:19.510 INFO:tasks.rados.rados.0.smithi183.stdout:98: rollback oid 14 current snap is 5 2024-09-17T16:42:19.510 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 14 to 4 2024-09-17T16:42:19.511 INFO:tasks.rados.rados.0.smithi183.stdout:99: setattr oid 33 current snap is 5 2024-09-17T16:42:19.511 INFO:tasks.rados.rados.0.smithi183.stdout:100: rollback oid 36 current snap is 5 2024-09-17T16:42:19.511 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 36 to 4 2024-09-17T16:42:19.512 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 3 current snap is 5 2024-09-17T16:42:19.512 INFO:tasks.rados.rados.0.smithi183.stdout:101: seq_num 61 ranges {1032192=655360,1687552=376832} 2024-09-17T16:42:19.521 INFO:tasks.rados.rados.0.smithi183.stdout:101: writing smithi18337221-3 from 1032192 to 1687552 tid 1 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:101: writing smithi18337221-3 from 1687552 to 2064384 tid 2 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:102: snap_create 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:100: finishing rollback tid 0 to smithi18337221-36 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:100: finishing rollback tid 1 to smithi18337221-36 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:98: finishing rollback tid 0 to smithi18337221-14 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:100: finishing rollback tid 2 to smithi18337221-36 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 36 v 13 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:98: finishing rollback tid 1 to smithi18337221-14 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:98: finishing rollback tid 2 to smithi18337221-14 2024-09-17T16:42:19.524 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 14 v 32 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-09-17T16:42:19.530 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 34 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-09-17T16:42:19.531 INFO:tasks.rados.rados.0.smithi183.stdout:97: finishing write tid 1 to smithi18337221-29 2024-09-17T16:42:19.531 INFO:tasks.rados.rados.0.smithi183.stdout:97: finishing write tid 2 to smithi18337221-29 2024-09-17T16:42:19.531 INFO:tasks.rados.rados.0.smithi183.stdout:97: finishing write tid 3 to smithi18337221-29 2024-09-17T16:42:19.533 INFO:tasks.rados.rados.0.smithi183.stdout:97: finishing write tid 4 to smithi18337221-29 2024-09-17T16:42:19.533 INFO:tasks.rados.rados.0.smithi183.stdout:97: oid 29 updating version 0 to 9 2024-09-17T16:42:19.533 INFO:tasks.rados.rados.0.smithi183.stdout:97: oid 29 version 9 is already newer than 8 2024-09-17T16:42:19.533 INFO:tasks.rados.rados.0.smithi183.stdout:97: oid 29 updating version 9 to 10 2024-09-17T16:42:19.533 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 29 v 10 (ObjNum 60 snap 5 seq_num 60) dirty exists 2024-09-17T16:42:19.533 INFO:tasks.rados.rados.0.smithi183.stdout:97: left oid 29 (ObjNum 60 snap 5 seq_num 60) 2024-09-17T16:42:19.535 INFO:tasks.rados.rados.0.smithi183.stdout:101: finishing write tid 1 to smithi18337221-3 2024-09-17T16:42:19.536 INFO:tasks.rados.rados.0.smithi183.stdout:101: finishing write tid 2 to smithi18337221-3 2024-09-17T16:42:19.536 INFO:tasks.rados.rados.0.smithi183.stdout:101: finishing write tid 3 to smithi18337221-3 2024-09-17T16:42:19.536 INFO:tasks.rados.rados.0.smithi183.stdout:101: finishing write tid 4 to smithi18337221-3 2024-09-17T16:42:19.537 INFO:tasks.rados.rados.0.smithi183.stdout:101: oid 3 updating version 0 to 14 2024-09-17T16:42:19.537 INFO:tasks.rados.rados.0.smithi183.stdout:101: oid 3 version 14 is already newer than 13 2024-09-17T16:42:19.537 INFO:tasks.rados.rados.0.smithi183.stdout:101: oid 3 version 14 is already newer than 12 2024-09-17T16:42:19.537 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 3 v 14 (ObjNum 61 snap 5 seq_num 61) dirty exists 2024-09-17T16:42:19.537 INFO:tasks.rados.rados.0.smithi183.stdout:101: left oid 3 (ObjNum 61 snap 5 seq_num 61) 2024-09-17T16:42:19.555 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:42:19.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:19.570 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:19.568+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:19.593 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:19.593 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:19.594 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:19.594 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.602 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:19.671 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:19.668+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:19.694 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:19.695 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=24, reqid=client.4553.0:217, at_version=40'7, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:19.707 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.497613+0000", 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.207481918, 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012779860000000001, 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497613+0000", 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497613+0000", 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497613+0000", 2024-09-17T16:42:19.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5699999999999999e-07 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497648+0000", 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.485e-05 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497662+0000", 2024-09-17T16:42:19.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4640999999999999e-05 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497673+0000", 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0267e-05 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497759+0000", 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5981000000000002e-05 2024-09-17T16:42:19.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497769+0000", 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0387999999999999e-05 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498864+0000", 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010951069999999999 2024-09-17T16:42:19.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498891+0000", 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6495e-05 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.713 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.206547134, 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048787229999999997, 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498548+0000", 2024-09-17T16:42:19.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6599999999999996e-07 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498566+0000", 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7934000000000001e-05 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498578+0000", 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1769e-05 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498583+0000", 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7769999999999999e-06 2024-09-17T16:42:19.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498647+0000", 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3689000000000006e-05 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498657+0000", 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3740000000000004e-06 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503393+0000", 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004736428 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503426+0000", 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3086000000000001e-05 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=26, reqid=client.4553.0:219, at_version=40'9, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499781+0000", 2024-09-17T16:42:19.720 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.2053132890000002, 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036671590000000001, 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499781+0000", 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499781+0000", 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499782+0000", 2024-09-17T16:42:19.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9299999999999998e-07 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499797+0000", 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5494000000000001e-05 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499813+0000", 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5316e-05 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499819+0000", 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7089999999999996e-06 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499887+0000", 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8113000000000003e-05 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499896+0000", 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503429+0000", 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035329559999999999 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503448+0000", 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9633999999999999e-05 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.204806993, 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091284039999999997, 2024-09-17T16:42:19.726 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500288+0000", 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8799999999999998e-07 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500609+0000", 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000321482 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500624+0000", 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4558e-05 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500632+0000", 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2024-09-17T16:42:19.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500693+0000", 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1045999999999998e-05 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500703+0000", 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9899999999999992e-06 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509375+0000", 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086724420000000007 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509416+0000", 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0639000000000002e-05 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=27, reqid=client.4553.0:219, at_version=0'0, trim_to=0'0, roll_forward_to=40'9))", 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.507863+0000", 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1972312709999997, 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001777074, 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507863+0000", 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507863+0000", 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507864+0000", 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2799999999999996e-07 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507873+0000", 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2240000000000001e-06 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507883+0000", 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5719999999999992e-06 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507888+0000", 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1490000000000002e-06 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507931+0000", 2024-09-17T16:42:19.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3476000000000002e-05 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.507942+0000", 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1029000000000001e-05 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509603+0000", 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001661091 2024-09-17T16:42:19.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509640+0000", 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6905e-05 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=15, reqid=client.4553.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.510850+0000", 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.1942441339999998, 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015302989999999999, 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510850+0000", 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510850+0000", 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510851+0000", 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3799999999999996e-07 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510862+0000", 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1051e-05 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510878+0000", 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5417000000000002e-05 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510886+0000", 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1419999999999993e-06 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510947+0000", 2024-09-17T16:42:19.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0903999999999998e-05 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510957+0000", 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0013000000000001e-05 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512348+0000", 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013913300000000001 2024-09-17T16:42:19.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.512381+0000", 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2604000000000002e-05 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 41/34 ECSubWrite(tid=16, reqid=client.4553.0:221, at_version=41'10, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:14.481629+0000", 2024-09-17T16:42:19.743 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2234652060000002, 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0027015849999999998, 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481629+0000", 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481629+0000", 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481630+0000", 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481829+0000", 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000199352 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481845+0000", 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5610000000000001e-05 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.746 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481858+0000", 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3623e-05 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481923+0000", 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4444999999999997e-05 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.481935+0000", 2024-09-17T16:42:19.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2011000000000001e-05 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.484300+0000", 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023649919999999998 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.484331+0000", 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0948999999999998e-05 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.748 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 41/34 ECSubWrite(tid=17, reqid=client.4553.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=41'10))", 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:14.485956+0000", 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2191389429999999, 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062125199999999998, 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.749 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.485956+0000", 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.485956+0000", 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.485956+0000", 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4499999999999997e-07 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.485966+0000", 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0013000000000001e-05 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.485977+0000", 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1116e-05 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.485986+0000", 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6489999999999997e-06 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.486044+0000", 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7914000000000002e-05 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.486055+0000", 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1076e-05 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.486549+0000", 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049386999999999999 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:14.486577+0000", 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7968999999999999e-05 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.18233464899999999, 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010249355999999999, 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2e-07 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523388+0000", 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062798599999999997 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523412+0000", 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3898999999999999e-05 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523422+0000", 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0259e-05 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523489+0000", 2024-09-17T16:42:19.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7070000000000007e-05 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523500+0000", 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0617e-05 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532963+0000", 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009463183 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533009+0000", 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5921999999999998e-05 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=20, reqid=client.4553.0:271, at_version=46'13, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.17701097499999999, 2024-09-17T16:42:19.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053659780000000004, 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528084+0000", 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228254 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528326+0000", 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.366e-05 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528334+0000", 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3000000000000002e-06 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529561+0000", 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226293 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529570+0000", 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5820000000000008e-06 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533417+0000", 2024-09-17T16:42:19.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003846576 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533449+0000", 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2694000000000002e-05 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=21, reqid=client.4553.0:272, at_version=46'14, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:19.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.530892+0000", 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.17420197400000001, 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002853151, 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530892+0000", 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530892+0000", 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530893+0000", 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1200000000000001e-07 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530916+0000", 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2920000000000001e-05 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530933+0000", 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6707000000000001e-05 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530942+0000", 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6570000000000003e-06 2024-09-17T16:42:19.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532783+0000", 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001841295 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532795+0000", 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1789e-05 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533712+0000", 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00091691099999999996 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533746+0000", 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.396e-05 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.770 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.772 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=22, reqid=client.4553.0:272, at_version=0'0, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.535138+0000", 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.169956684, 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055590900000000005, 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535138+0000", 2024-09-17T16:42:19.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535138+0000", 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535140+0000", 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6840000000000001e-06 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535150+0000", 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2799999999999992e-06 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535162+0000", 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2656e-05 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535171+0000", 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6619999999999994e-06 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535242+0000", 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.08e-05 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535252+0000", 2024-09-17T16:42:19.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0366999999999999e-05 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535658+0000", 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040557199999999999 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.535694+0000", 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5887999999999999e-05 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.777 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:19.778 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:19.778 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.779 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:19.779 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:19.780 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:19.780 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:19.781 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:19.781 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:19.777+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:19.794 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:19.794 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:19.815 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:19.815 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:19.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:19.832 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:19.849 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:19.849 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:19.866 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:19.867 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:19.880 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:19.877+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:19.883 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:19.883 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:19.899 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:19.900 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:19.917 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:19.917 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:19.926 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:19.926 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:19.926 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:19.926 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:19.934 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:19.934 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:19.935 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:19.950 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:19.950 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:19.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:19.964+0000 7fba2f7fe640 0 -- 172.21.15.60:0/1366755662 >> [v2:172.21.15.98:6816/2084737149,v1:172.21.15.98:6817/2084737149] conn(0x7fba3021e4a0 msgr2=0x7fba30220890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:19.969 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:19.981 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:19.979+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:19.986 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:19.986 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:20.004 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:20.004 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:20.038 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.038 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:20.090 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:20.088+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:20.149 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.149 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.154 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:20.154 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:20.155 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-17T16:42:20.155 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T16:42:20.155 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T16:42:20.155 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-17T16:42:20.157 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:20.198 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:20.196+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:20.257 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:20.257 INFO:teuthology.orchestra.run.smithi098.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T16:42:20.258 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:20.273 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.273 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.282 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:20.307 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:20.305+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:20.385 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:20.383+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:20.385 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.385 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.394 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:20.433 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:42:20.436 INFO:tasks.rados.rados.0.smithi183.stdout:97: done (5 left) 2024-09-17T16:42:20.436 INFO:tasks.rados.rados.0.smithi183.stdout:98: done (4 left) 2024-09-17T16:42:20.436 INFO:tasks.rados.rados.0.smithi183.stdout:99: done (3 left) 2024-09-17T16:42:20.436 INFO:tasks.rados.rados.0.smithi183.stdout:100: done (2 left) 2024-09-17T16:42:20.436 INFO:tasks.rados.rados.0.smithi183.stdout:101: done (1 left) 2024-09-17T16:42:20.436 INFO:tasks.rados.rados.0.smithi183.stdout:102: done (0 left) 2024-09-17T16:42:20.437 INFO:tasks.rados.rados.0.smithi183.stdout:103: rmattr oid 6 current snap is 6 2024-09-17T16:42:20.437 INFO:tasks.rados.rados.0.smithi183.stdout:103: done (0 left) 2024-09-17T16:42:20.437 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 11 current snap is 6 2024-09-17T16:42:20.437 INFO:tasks.rados.rados.0.smithi183.stdout:104: seq_num 62 ranges {589824=671744,1261568=376832} 2024-09-17T16:42:20.443 INFO:tasks.rados.rados.0.smithi183.stdout:104: writing smithi18337221-11 from 589824 to 1261568 tid 1 2024-09-17T16:42:20.445 INFO:tasks.rados.rados.0.smithi183.stdout:104: writing smithi18337221-11 from 1261568 to 1638400 tid 2 2024-09-17T16:42:20.445 INFO:tasks.rados.rados.0.smithi183.stdout:105: read oid 32 snap 4 2024-09-17T16:42:20.445 INFO:tasks.rados.rados.0.smithi183.stdout:105: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:20.445 INFO:tasks.rados.rados.0.smithi183.stdout:106: setattr oid 2 current snap is 6 2024-09-17T16:42:20.447 INFO:tasks.rados.rados.0.smithi183.stdout:107: snap_create 2024-09-17T16:42:20.455 INFO:tasks.rados.rados.0.smithi183.stdout:105: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:20.455 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 112194 2024-09-17T16:42:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 72602 2024-09-17T16:42:20.458 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:20.460 INFO:tasks.rados.rados.0.smithi183.stdout:104: finishing write tid 1 to smithi18337221-11 2024-09-17T16:42:20.460 INFO:tasks.rados.rados.0.smithi183.stdout:104: finishing write tid 2 to smithi18337221-11 2024-09-17T16:42:20.460 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 2 v 13 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-09-17T16:42:20.460 INFO:tasks.rados.rados.0.smithi183.stdout:104: finishing write tid 3 to smithi18337221-11 2024-09-17T16:42:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:104: finishing write tid 4 to smithi18337221-11 2024-09-17T16:42:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:104: oid 11 updating version 0 to 36 2024-09-17T16:42:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:104: oid 11 updating version 36 to 37 2024-09-17T16:42:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:104: oid 11 updating version 37 to 38 2024-09-17T16:42:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 38 (ObjNum 62 snap 6 seq_num 62) dirty exists 2024-09-17T16:42:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:104: left oid 11 (ObjNum 62 snap 6 seq_num 62) 2024-09-17T16:42:20.485 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:20.483+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:20.502 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.502 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.511 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:20.586 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:20.583+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:20.613 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.613 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.622 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:20.688 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:20.685+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:20.765 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.765 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.774 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:20.787 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:20.785+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:20.877 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.877 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.885 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:20.888 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:20.886+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:20.988 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:20.989 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:20.989 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:20.987+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:20.996 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:21.090 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:21.087+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:21.098 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.099 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.107 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:21.191 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:21.188+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:21.249 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.249 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:21.291 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:21.290+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:21.392 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:21.390+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:21.400 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.401 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.409 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:104: done (3 left) 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:105: done (2 left) 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:106: done (1 left) 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:107: done (0 left) 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:108: rmattr oid 13 current snap is 7 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:108: done (0 left) 2024-09-17T16:42:21.438 INFO:tasks.rados.rados.0.smithi183.stdout:109: snap_create 2024-09-17T16:42:21.494 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:21.492+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:21.511 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.511 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.520 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:21.594 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:21.593+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:21.624 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.624 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.632 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:21.695 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:21.693+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.758 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:21.797 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:21.794+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:21.861 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.862 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.870 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:21.898 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:21.896+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:21.973 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:21.973 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:21.982 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:21.998 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:21.996+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:22.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:22.085 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:22.085 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:22.093 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:22.099 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:22.097+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:22.155 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:22.174 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:22.174 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:22.191 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:22.192 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:22.196 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:22.196 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:22.199 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:22.197+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:22.205 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:22.209 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:22.209 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:22.225 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:22.225 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:22.242 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:22.242 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:22.259 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:22.260 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:22.276 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:22.276 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:22.292 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:22.300 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:22.298+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:22.309 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:22.309 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:22.310 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:22.310 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:22.310 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:22.310 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:22.310 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.310 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.as2 40/34 ECSubRead(tid=25, to_read={3:5b2a661d:::smithi18337221-31:head=98304,28672,0}, subchunks={3:5b2a661d:::smithi18337221-31:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.478491+0000", 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8289299079999992, 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00050270299999999996, 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478491+0000", 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.311 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478491+0000", 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478491+0000", 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5200000000000001e-07 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478516+0000", 2024-09-17T16:42:22.312 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5313e-05 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478529+0000", 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2685e-05 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478539+0000", 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0453e-05 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.313 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478606+0000", 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6324999999999999e-05 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478993+0000", 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038777499999999998 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.314 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.as2 40/34 ECSubRead(tid=26, to_read={3:5b2a661d:::smithi18337221-31:head=0,126976,0}, subchunks={3:5b2a661d:::smithi18337221-31:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.478769+0000", 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8286520849999999, 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00076741600000000004, 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478769+0000", 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.315 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478769+0000", 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478769+0000", 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9699999999999996e-07 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478778+0000", 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3869999999999995e-06 2024-09-17T16:42:22.316 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478786+0000", 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6270000000000006e-06 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.478795+0000", 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4039999999999995e-06 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479043+0000", 2024-09-17T16:42:22.317 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00024819000000000002 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00049321100000000002 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.as2 40/34 ECSubRead(tid=27, to_read={3:5b2a661d:::smithi18337221-31:head=24576,102400,0}, subchunks={3:5b2a661d:::smithi18337221-31:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.479065+0000", 2024-09-17T16:42:22.318 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8283552669999992, 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00062200199999999997, 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479065+0000", 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479065+0000", 2024-09-17T16:42:22.319 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479066+0000", 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8100000000000003e-07 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479071+0000", 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4e-06 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.320 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479091+0000", 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9868e-05 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479103+0000", 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1796e-05 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479580+0000", 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00047681200000000001 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.321 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.479687+0000", 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000107645 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8258184669999995, 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079208060000000007, 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.322 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.323 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481603+0000", 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.75e-07 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482071+0000", 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046812600000000002 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482084+0000", 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3057000000000001e-05 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.324 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482091+0000", 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3540000000000002e-06 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482223+0000", 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013139799999999999 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482253+0000", 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0824000000000002e-05 2024-09-17T16:42:22.325 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489462+0000", 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007208356 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489523+0000", 2024-09-17T16:42:22.326 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1216000000000005e-05 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.as2 40/34 ECSubRead(tid=28, to_read={3:53f17c76:::smithi18337221-27:head=0,110592,0}, subchunks={3:53f17c76:::smithi18337221-27:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492068+0000", 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8153525869999996, 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015074940000000001, 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.327 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492068+0000", 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492068+0000", 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492069+0000", 2024-09-17T16:42:22.328 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1060000000000001e-06 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492084+0000", 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4895999999999999e-05 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492102+0000", 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8213999999999999e-05 2024-09-17T16:42:22.329 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492115+0000", 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492214+0000", 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8956000000000006e-05 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.330 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493576+0000", 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0013619439999999999 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.7s2 40/34 ECSubRead(tid=64, to_read={3:edf9cac5:::smithi18337221-37:head=0,151552,0}, subchunks={3:edf9cac5:::smithi18337221-37:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492250+0000", 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8151704990000006, 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082466699999999996, 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.331 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492250+0000", 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.332 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492250+0000", 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492251+0000", 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7300000000000004e-07 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.333 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492262+0000", 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0506000000000001e-05 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492275+0000", 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2948e-05 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492284+0000", 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8160000000000005e-06 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.334 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492380+0000", 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5805999999999997e-05 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493075+0000", 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00069461800000000004 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.335 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.7s2 40/34 ECSubRead(tid=66, to_read={3:edf9cac5:::smithi18337221-37:head=0,151552,0}, subchunks={3:edf9cac5:::smithi18337221-37:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.494848+0000", 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8125731379999994, 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00030900300000000002, 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.494848+0000", 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.336 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.494848+0000", 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.494848+0000", 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.337 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.494854+0000", 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1909999999999997e-06 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.494871+0000", 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7226000000000001e-05 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.494881+0000", 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6870000000000006e-06 2024-09-17T16:42:22.338 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.495065+0000", 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018367000000000001 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.495157+0000", 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1827e-05 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.339 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498775+0000", 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.808646092, 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057659850000000004, 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498775+0000", 2024-09-17T16:42:22.340 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498775+0000", 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498776+0000", 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.294e-06 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.341 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498945+0000", 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016891000000000001 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498966+0000", 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.143e-05 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498975+0000", 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2350000000000005e-06 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.342 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499057+0000", 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1497999999999998e-05 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499069+0000", 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2118e-05 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504499+0000", 2024-09-17T16:42:22.343 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054296769999999999 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504541+0000", 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1823000000000003e-05 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:22.344 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8076768479999998, 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062455490000000004, 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:22.345 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499751+0000", 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8290000000000002e-06 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500848+0000", 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001096889 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.346 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500866+0000", 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8899999999999999e-05 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500877+0000", 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0709e-05 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500961+0000", 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3460000000000004e-05 2024-09-17T16:42:22.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500974+0000", 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3546e-05 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505946+0000", 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049713459999999998 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505989+0000", 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3869999999999998e-05 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=69, reqid=client.4553.0:185, at_version=40'17, trim_to=0'0, roll_forward_to=40'15))", 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.505705+0000", 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8017159710000001, 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001065442, 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.349 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505705+0000", 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505705+0000", 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505706+0000", 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.364e-06 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505733+0000", 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6429000000000001e-05 2024-09-17T16:42:22.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505745+0000", 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2336e-05 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505768+0000", 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3314000000000001e-05 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505830+0000", 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2080000000000002e-05 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505840+0000", 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0227999999999999e-05 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506744+0000", 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00090308200000000004 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.353 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506770+0000", 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6608999999999999e-05 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=71, reqid=client.4553.0:185, at_version=0'0, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.509144+0000", 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7982765440000001, 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000667547, 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.354 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509144+0000", 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509144+0000", 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509145+0000", 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2330000000000001e-06 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509158+0000", 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2208000000000001e-05 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509175+0000", 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7436999999999999e-05 2024-09-17T16:42:22.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509183+0000", 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9300000000000003e-06 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509255+0000", 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1730000000000006e-05 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509271+0000", 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6308e-05 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509776+0000", 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00050512199999999999 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509812+0000", 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5578999999999999e-05 2024-09-17T16:42:22.358 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 40/34 ECSubWrite(tid=15, reqid=client.4553.0:209, at_version=0'0, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.510354+0000", 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7970666840000007, 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0013927220000000001, 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510354+0000", 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510354+0000", 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510355+0000", 2024-09-17T16:42:22.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0200000000000002e-07 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510367+0000", 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2884999999999999e-05 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510397+0000", 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9448999999999999e-05 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510406+0000", 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6759999999999996e-06 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510475+0000", 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9635000000000007e-05 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510486+0000", 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0548e-05 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511703+0000", 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00121682 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511747+0000", 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4107000000000003e-05 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=73, reqid=client.4553.0:197, at_version=40'19, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.512914+0000", 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7945065709999994, 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0021550419999999998, 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512914+0000", 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512914+0000", 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512915+0000", 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513034+0000", 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011887699999999999 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513046+0000", 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1975e-05 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513054+0000", 2024-09-17T16:42:22.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9240000000000007e-06 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513116+0000", 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1808000000000002e-05 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513122+0000", 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4219999999999997e-06 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.515037+0000", 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019149239999999999 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.515069+0000", 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2254e-05 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.368 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=74, reqid=client.4553.0:197, at_version=0'0, trim_to=0'0, roll_forward_to=40'19))", 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.516973+0000", 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7904474439999998, 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00073994000000000002, 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.516973+0000", 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.516973+0000", 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.516974+0000", 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0999999999999997e-07 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.516991+0000", 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6776999999999999e-05 2024-09-17T16:42:22.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.517006+0000", 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5523e-05 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.517015+0000", 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5599999999999994e-06 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.517075+0000", 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0489999999999999e-05 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.517086+0000", 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0728e-05 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.517684+0000", 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059792600000000003 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.517713+0000", 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9026e-05 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 41/34 ECSubWrite(tid=16, reqid=client.4553.0:221, at_version=41'10, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 7.8258561350000004, 2024-09-17T16:42:22.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0029992180000000001, 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.55e-07 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481702+0000", 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000137713 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481718+0000", 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5668e-05 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481731+0000", 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2537999999999999e-05 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481828+0000", 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7083000000000005e-05 2024-09-17T16:42:22.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481842+0000", 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789e-05 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.484527+0000", 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026840290000000001 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.484564+0000", 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7243000000000002e-05 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 41/34 ECSubWrite(tid=17, reqid=client.4553.0:221, at_version=0'0, trim_to=0'0, roll_forward_to=41'10))", 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:14.485968+0000", 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 7.8214531090000001, 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00074264999999999997, 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.378 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.485968+0000", 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.485968+0000", 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.485969+0000", 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0499999999999999e-06 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.485988+0000", 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9116000000000001e-05 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.486004+0000", 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6453e-05 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.486014+0000", 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7429999999999997e-06 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.486094+0000", 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0476000000000007e-05 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.486104+0000", 2024-09-17T16:42:22.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7140000000000005e-06 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.486666+0000", 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00056237400000000003 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.486710+0000", 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3723999999999997e-05 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 2.795804263, 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066825230000000001, 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:22.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511617+0000", 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512095+0000", 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00047857800000000001 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6481999999999999e-05 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512122+0000", 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0195e-05 2024-09-17T16:42:22.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512212+0000", 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9619999999999999e-05 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512224+0000", 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1997999999999999e-05 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518268+0000", 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060445969999999996 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518299+0000", 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0811e-05 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.387 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 2.787468514, 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003840053, 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.519953+0000", 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9599999999999998e-07 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520159+0000", 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020548800000000001 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520171+0000", 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2687999999999999e-05 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520178+0000", 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2899999999999999e-06 2024-09-17T16:42:22.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520225+0000", 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7772999999999998e-05 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520232+0000", 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9809999999999997e-06 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523752+0000", 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035199960000000001 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523792+0000", 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9941000000000003e-05 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=34, reqid=client.4553.0:261, at_version=46'10, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:22.392 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522969+0000", 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 2.7844513900000001, 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00177326, 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522969+0000", 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522969+0000", 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522971+0000", 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2389999999999999e-06 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523011+0000", 2024-09-17T16:42:22.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0433999999999999e-05 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523026+0000", 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5481999999999998e-05 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523036+0000", 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2040000000000003e-06 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523441+0000", 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00040572699999999999 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523459+0000", 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7200000000000001e-05 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.524721+0000", 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001262109 2024-09-17T16:42:22.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.524743+0000", 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1865000000000002e-05 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=35, reqid=client.4553.0:261, at_version=0'0, trim_to=0'0, roll_forward_to=46'10))", 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.531517+0000", 2024-09-17T16:42:22.397 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 2.7759036400000001, 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00052215300000000003, 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531517+0000", 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531517+0000", 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531518+0000", 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.004e-06 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531532+0000", 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3691e-05 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531547+0000", 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5529e-05 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531557+0000", 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2450000000000004e-06 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531614+0000", 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7123000000000002e-05 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531620+0000", 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7510000000000002e-06 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.532008+0000", 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038788199999999998 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.532039+0000", 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0927999999999999e-05 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.402 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:22.403 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:22.403 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:22.404 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:22.404 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:22.405 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:22.405 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:22.406 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:22.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:22.375+0000 7f91db7fe640 0 -- 172.21.15.60:0/1353828023 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7f91dc221370 msgr2=0x7f91dc223760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:22.407 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:22.401+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:22.441 INFO:tasks.rados.rados.0.smithi183.stdout:109: done (0 left) 2024-09-17T16:42:22.441 INFO:tasks.rados.rados.0.smithi183.stdout:110: rmattr oid 25 current snap is 8 2024-09-17T16:42:22.441 INFO:tasks.rados.rados.0.smithi183.stdout:110: done (0 left) 2024-09-17T16:42:22.441 INFO:tasks.rados.rados.0.smithi183.stdout:111: delete oid 18 current snap is 8 2024-09-17T16:42:22.444 INFO:tasks.rados.rados.0.smithi183.stdout:111: done (0 left) 2024-09-17T16:42:22.444 INFO:tasks.rados.rados.0.smithi183.stdout:112: snap_create 2024-09-17T16:42:22.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:42:22.504 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:22.502+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:22.511 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:22.511 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:22.511 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:22.512 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:22.519 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:22.595 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:22.595 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:22.605 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:22.602+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:22.612 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:22.612 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:22.661 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:22.662 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:22.662 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:22.662 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:22.662 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:22.670 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:22.706 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:22.704+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4353.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 27.656418072000001, 2024-09-17T16:42:22.774 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019887846000000001, 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4353", 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 1 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.775 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114602+0000", 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4899999999999999e-06 2024-09-17T16:42:22.776 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114608+0000", 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5269999999999998e-06 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114617+0000", 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.777 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114624+0000", 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114751+0000", 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012672599999999999 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.778 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114762+0000", 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0988000000000001e-05 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133140+0000", 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018378205000000002 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.779 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133255+0000", 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011454 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 5", 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133361+0000", 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134291+0000", 2024-09-17T16:42:22.780 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00092989899999999998 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134428+0000", 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013742100000000001 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134460+0000", 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1696000000000003e-05 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.781 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134488+0000", 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8839999999999998e-05 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:180 3.8s0 3:1f669f2f:::smithi18337221-38:head [copy-from ver 4] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.310474696, 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539511, 2024-09-17T16:42:22.782 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 180 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460545+0000", 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789999999999999e-06 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.784 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460557+0000", 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1426e-05 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460574+0000", 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7201e-05 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460585+0000", 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1151e-05 2024-09-17T16:42:22.785 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460659+0000", 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3627000000000005e-05 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460665+0000", 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8799999999999996e-06 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.786 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465756+0000", 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050914580000000001 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465824+0000", 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7695999999999997e-05 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.787 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.471499+0000", 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056752800000000004 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474733+0000", 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336159999999999 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475885+0000", 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011522209999999999 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.788 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475939+0000", 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4075e-05 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:181 3.8s0 3:1f669f2f:::smithi18337221-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.310411849999999, 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012676972999999999, 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.789 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 181 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.790 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7700000000000005e-07 2024-09-17T16:42:22.791 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460610+0000", 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.255e-06 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460615+0000", 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4210000000000003e-06 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460619+0000", 2024-09-17T16:42:22.792 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9580000000000001e-06 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460721+0000", 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000101939 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460728+0000", 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8040000000000004e-06 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.793 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466017+0000", 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052897680000000002 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466075+0000", 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7250999999999998e-05 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.794 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473120+0000", 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070448159999999998 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473208+0000", 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8794000000000004e-05 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473284+0000", 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5489999999999997e-05 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.795 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs2 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481232+0000", 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2897864420000005, 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073714469999999997, 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.796 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481232+0000", 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481232+0000", 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481232+0000", 2024-09-17T16:42:22.797 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2999999999999999e-07 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481608+0000", 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037538099999999999 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481620+0000", 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1793999999999999e-05 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.798 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481628+0000", 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6610000000000006e-06 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481733+0000", 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010461199999999999 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481744+0000", 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1168999999999999e-05 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.799 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488166+0000", 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064217709999999997 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488604+0000", 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00043782899999999999 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.800 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:205 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~540672] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2844148069999992, 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022798883999999998, 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 205 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.801 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486616+0000", 2024-09-17T16:42:22.802 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2235999999999999e-05 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487273+0000", 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065649800000000004 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487287+0000", 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4691e-05 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.803 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487297+0000", 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6360000000000006e-06 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488723+0000", 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014264239999999999 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488837+0000", 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011340000000000001 2024-09-17T16:42:22.804 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490257+0000", 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014198100000000001 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503813+0000", 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013556586000000001 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:22.805 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509302+0000", 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054885029999999996 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001011 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.806 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:206 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2812342989999994, 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020001278000000001, 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 206 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.807 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.809 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.809 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.809 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489787+0000", 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.193e-06 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.810 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490081+0000", 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029397100000000002 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490112+0000", 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1084999999999998e-05 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490123+0000", 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1440999999999999e-05 2024-09-17T16:42:22.811 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498510+0000", 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083867290000000008 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498626+0000", 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011602700000000001 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.812 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499572+0000", 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00094589999999999995 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504786+0000", 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005214148 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509716+0000", 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049301520000000001 2024-09-17T16:42:22.813 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509786+0000", 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9632e-05 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:207 3.8s0 3:1b608a02:::smithi18337221-50:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2808761180000001, 2024-09-17T16:42:22.814 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020510362000000001, 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 207 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:22.815 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.816 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490149+0000", 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.135e-06 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490157+0000", 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9060000000000002e-06 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490162+0000", 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1229999999999999e-06 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.817 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505559+0000", 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539709 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505695+0000", 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135969 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506337+0000", 2024-09-17T16:42:22.818 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064216000000000002 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507545+0000", 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012081609999999999 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510574+0000", 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030285519999999999 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.819 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510653+0000", 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9348e-05 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:208 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.280848057, 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021610111000000001, 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.820 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 208 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.821 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490174+0000", 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7350000000000001e-06 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.822 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490181+0000", 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9890000000000003e-06 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490186+0000", 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2299999999999999e-06 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506594+0000", 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016408049000000001 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507224+0000", 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000629881 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510953+0000", 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037285399999999998 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511114+0000", 2024-09-17T16:42:22.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016097400000000001 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511781+0000", 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066716099999999999 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.8s0 40/34 ECSubWriteReply(tid=12, last_complete=40'9, committed=1, applied=1))", 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.497296+0000", 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2737229479999996, 2024-09-17T16:42:22.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065722480000000002, 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497296+0000", 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497296+0000", 2024-09-17T16:42:22.826 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497297+0000", 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8000000000000005e-07 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497301+0000", 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5279999999999997e-06 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497310+0000", 2024-09-17T16:42:22.827 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5099999999999998e-06 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497317+0000", 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.345e-06 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503851+0000", 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065337620000000003 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503868+0000", 2024-09-17T16:42:22.828 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7323e-05 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=24, reqid=client.4553.0:217, at_version=40'7, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2736130469999996, 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077578639999999997, 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.829 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.41e-07 2024-09-17T16:42:22.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497426+0000", 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0489999999999999e-05 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497452+0000", 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5528e-05 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497458+0000", 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8510000000000004e-06 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503461+0000", 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060033170000000002 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503471+0000", 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7669999999999998e-06 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505129+0000", 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016584410000000001 2024-09-17T16:42:22.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505164+0000", 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4128999999999998e-05 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.8s0 40/34 ECSubWriteReply(tid=12, last_complete=40'9, committed=1, applied=1))", 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498655+0000", 2024-09-17T16:42:22.833 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2723638770000001, 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0061330639999999997, 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498655+0000", 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498655+0000", 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498656+0000", 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1310000000000001e-06 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498662+0000", 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.981e-06 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498675+0000", 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3501e-05 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498692+0000", 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6116e-05 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504766+0000", 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060744099999999997 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504788+0000", 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1925000000000001e-05 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.837 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2723597590000004, 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086096929999999999, 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.838 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498660+0000", 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2399999999999996e-07 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.839 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498679+0000", 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9306000000000001e-05 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498692+0000", 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3247999999999999e-05 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498711+0000", 2024-09-17T16:42:22.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8244e-05 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503918+0000", 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052073960000000004 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503938+0000", 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0027999999999999e-05 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507239+0000", 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033006559999999999 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507269+0000", 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9890999999999999e-05 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.8s0 40/34 ECSubWriteReply(tid=12, last_complete=40'9, committed=1, applied=1))", 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498916+0000", 2024-09-17T16:42:22.842 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2721024409999995, 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059158229999999997, 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498916+0000", 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.843 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498916+0000", 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498917+0000", 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6600000000000005e-07 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498922+0000", 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9219999999999996e-06 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.844 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498934+0000", 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1538e-05 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498940+0000", 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7710000000000001e-06 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.845 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504817+0000", 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058764209999999997 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504832+0000", 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5305e-05 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.8s0 40/34 ECSubWriteReply(tid=13, last_complete=40'11, committed=1, applied=1))", 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498942+0000", 2024-09-17T16:42:22.846 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2720771420000005, 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059344740000000003, 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498942+0000", 2024-09-17T16:42:22.847 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498942+0000", 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498943+0000", 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.077e-06 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.848 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498947+0000", 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6179999999999997e-06 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1406000000000001e-05 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498966+0000", 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5240000000000003e-06 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.849 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504861+0000", 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058946909999999996 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504876+0000", 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5158e-05 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.1s3 40/34 ECSubRead(tid=67, to_read={3:8551e558:::smithi18337221-41:head=0,172032,0}, subchunks={3:8551e558:::smithi18337221-41:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:22.850 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499252+0000", 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2717666560000005, 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073510770000000001, 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499252+0000", 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499252+0000", 2024-09-17T16:42:22.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499252+0000", 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.22e-07 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499258+0000", 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2129999999999999e-06 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.852 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499294+0000", 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6257999999999997e-05 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499311+0000", 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7059999999999999e-05 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506205+0000", 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068938439999999997 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.853 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506603+0000", 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039837999999999999 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs2 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499377+0000", 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2716411989999994, 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057412770000000004, 2024-09-17T16:42:22.854 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499377+0000", 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.856 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499377+0000", 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499378+0000", 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.46e-07 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499587+0000", 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000208586 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499597+0000", 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0688e-05 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499606+0000", 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4880000000000007e-06 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.858 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499703+0000", 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7526000000000001e-05 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499713+0000", 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0030000000000001e-05 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505081+0000", 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053681709999999997 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505119+0000", 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7342000000000003e-05 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.8s0 40/34 ECSubWriteReply(tid=13, last_complete=40'11, committed=1, applied=1))", 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499626+0000", 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2713926749999995, 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0055406869999999999, 2024-09-17T16:42:22.860 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499626+0000", 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499626+0000", 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.861 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499627+0000", 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8400000000000004e-07 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499631+0000", 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5759999999999999e-06 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499644+0000", 2024-09-17T16:42:22.862 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2303000000000001e-05 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499652+0000", 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.721e-06 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505112+0000", 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054599239999999997 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.863 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505167+0000", 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4478999999999998e-05 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=26, reqid=client.4553.0:219, at_version=40'9, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2711859000000008, 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074558929999999999, 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.864 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.865 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499852+0000", 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8698e-05 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499864+0000", 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1633e-05 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499873+0000", 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0860000000000008e-06 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504903+0000", 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050303450000000003 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504912+0000", 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8219999999999996e-06 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507272+0000", 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0023596450000000001 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507289+0000", 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7033000000000001e-05 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.868 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.2705091530000008, 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074193640000000003, 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.869 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9800000000000002e-07 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500667+0000", 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156265 2024-09-17T16:42:22.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500697+0000", 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9807000000000001e-05 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500706+0000", 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7599999999999997e-06 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500843+0000", 2024-09-17T16:42:22.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013689600000000001 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500852+0000", 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3720000000000005e-06 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507885+0000", 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070330829999999999 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507929+0000", 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4283000000000003e-05 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s1 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2625767799999998, 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088156980000000003, 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:22.873 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:22.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509059+0000", 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00061633200000000003 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509089+0000", 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9966000000000001e-05 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509098+0000", 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509196+0000", 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7888999999999997e-05 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509204+0000", 2024-09-17T16:42:22.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1289999999999996e-06 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517216+0000", 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008012 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517258+0000", 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1189000000000002e-05 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.877 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:22.878 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:22.878 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:22.879 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:22.880 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:22.877+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:22.980 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:22.978+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:22.982 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:22.982 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:22.982 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:22.982 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:22.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:23.081 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:23.079+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:23.094 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:23.094 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:23.094 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:23.094 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:23.095 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:23.102 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:23.182 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:23.180+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:23.206 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:23.206 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:23.206 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:23.206 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.9s3 40/34 ECSubRead(tid=20, to_read={3:97a3b59a:::smithi18337221-19:head=0,77824,0}, subchunks={3:97a3b59a:::smithi18337221-19:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7228675710000001, 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0034770349999999998, 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:23.207 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.79e-07 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.208 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480671+0000", 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8090000000000004e-06 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480690+0000", 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9426e-05 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480702+0000", 2024-09-17T16:42:23.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1494999999999999e-05 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480784+0000", 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2408000000000001e-05 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484141+0000", 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033567179999999999 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.210 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.9s3 40/34 ECSubRead(tid=21, to_read={3:97a3b59a:::smithi18337221-19:head=0,77824,0}, subchunks={3:97a3b59a:::smithi18337221-19:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.480889+0000", 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7226420559999998, 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002994282, 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.211 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480889+0000", 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480889+0000", 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480890+0000", 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7400000000000003e-07 2024-09-17T16:42:23.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480899+0000", 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2240000000000001e-06 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480915+0000", 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5849999999999999e-05 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480926+0000", 2024-09-17T16:42:23.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0565e-05 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483787+0000", 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028613419999999998 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483884+0000", 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6626999999999995e-05 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.214 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.9s3 40/34 ECSubRead(tid=22, to_read={3:97a3b59a:::smithi18337221-19:head=0,77824,0}, subchunks={3:97a3b59a:::smithi18337221-19:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481313+0000", 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7222178429999992, 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027095629999999999, 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481313+0000", 2024-09-17T16:42:23.215 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481313+0000", 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481314+0000", 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0399999999999995e-07 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.216 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481322+0000", 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2579999999999995e-06 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481340+0000", 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7859999999999998e-05 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481350+0000", 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9930000000000007e-06 2024-09-17T16:42:23.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483918+0000", 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0025675519999999999 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484023+0000", 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000105196 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.218 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7126945370000008, 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080373609999999998, 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:23.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9900000000000001e-07 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490977+0000", 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000139412 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490997+0000", 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.052e-05 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491011+0000", 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4304999999999999e-05 2024-09-17T16:42:23.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491130+0000", 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011833900000000001 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491143+0000", 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2986000000000001e-05 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498835+0000", 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076927319999999999 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498874+0000", 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8668000000000003e-05 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.223 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.497829+0000", 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7057027619999996, 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016885750000000001, 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497829+0000", 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.224 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497829+0000", 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497829+0000", 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9500000000000001e-07 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497868+0000", 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8138e-05 2024-09-17T16:42:23.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497955+0000", 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7142e-05 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497970+0000", 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4878999999999999e-05 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.226 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498063+0000", 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3374000000000004e-05 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498073+0000", 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0190000000000001e-05 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499479+0000", 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001405578 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499517+0000", 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8379e-05 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499738+0000", 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7037936309999999, 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042740529999999999, 2024-09-17T16:42:23.228 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499738+0000", 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499738+0000", 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.229 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499739+0000", 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2550000000000001e-06 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499883+0000", 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014423699999999999 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499901+0000", 2024-09-17T16:42:23.230 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8097999999999999e-05 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499911+0000", 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8619999999999998e-06 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499974+0000", 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3220999999999997e-05 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.231 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499994+0000", 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9525999999999999e-05 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503965+0000", 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039709860000000001 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504012+0000", 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6867999999999999e-05 2024-09-17T16:42:23.232 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7029569430000002, 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062103369999999998, 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500575+0000", 2024-09-17T16:42:23.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8000000000000002e-07 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501024+0000", 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00044916500000000001 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501041+0000", 2024-09-17T16:42:23.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6782e-05 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501050+0000", 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9670000000000007e-06 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.236 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501115+0000", 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5790000000000005e-05 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501125+0000", 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5710000000000004e-06 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.237 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506743+0000", 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056177629999999996 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506785+0000", 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2018999999999999e-05 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.238 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=16, reqid=client.4553.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=40'13))", 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.510823+0000", 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.6927080510000003, 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001270326, 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510823+0000", 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.239 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510823+0000", 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510824+0000", 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3799999999999996e-07 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510834+0000", 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0336000000000001e-05 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510846+0000", 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1748e-05 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510853+0000", 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2060000000000001e-06 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510939+0000", 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6079e-05 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510949+0000", 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8609999999999993e-06 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512064+0000", 2024-09-17T16:42:23.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001114629 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512094+0000", 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9728999999999999e-05 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 41/34 ECSubWrite(tid=16, reqid=client.4553.0:221, at_version=41'10, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:14.481685+0000", 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7218459369999994, 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002748318, 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.244 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481685+0000", 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481685+0000", 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481686+0000", 2024-09-17T16:42:23.245 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5800000000000001e-07 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481792+0000", 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106729 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481805+0000", 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3169999999999999e-05 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.246 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481826+0000", 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0784e-05 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481912+0000", 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5698999999999994e-05 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.247 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481923+0000", 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0941000000000001e-05 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.484394+0000", 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002471174 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.484434+0000", 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9663000000000003e-05 2024-09-17T16:42:23.248 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.6953275080000001, 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0091817740000000002, 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.249 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:23.250 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.91e-07 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508622+0000", 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041787699999999998 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508636+0000", 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4331999999999999e-05 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.251 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508644+0000", 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508713+0000", 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9888000000000006e-05 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508723+0000", 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.713e-06 2024-09-17T16:42:23.252 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517349+0000", 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086254179999999993 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517386+0000", 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6971000000000002e-05 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.253 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=31, reqid=client.4553.0:252, at_version=45'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.514637+0000", 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.6888939629999999, 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035639069999999998, 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514637+0000", 2024-09-17T16:42:23.254 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514637+0000", 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514638+0000", 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5999999999999991e-07 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.255 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514870+0000", 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00023161199999999999 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514887+0000", 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7186000000000001e-05 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514897+0000", 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0125999999999999e-05 2024-09-17T16:42:23.256 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514953+0000", 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6030999999999999e-05 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514962+0000", 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9099999999999994e-06 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.257 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.518157+0000", 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031950540000000001 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.518201+0000", 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4027999999999999e-05 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=32, reqid=client.4553.0:253, at_version=45'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:23.258 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.517805+0000", 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.6857267660000002, 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002666645, 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517805+0000", 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517805+0000", 2024-09-17T16:42:23.259 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517805+0000", 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8199999999999999e-07 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517838+0000", 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3015999999999997e-05 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.260 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517853+0000", 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4207e-05 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517877+0000", 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3957000000000001e-05 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.261 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517951+0000", 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4219000000000002e-05 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517962+0000", 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1221e-05 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.520434+0000", 2024-09-17T16:42:23.262 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002472424 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.520471+0000", 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6819000000000001e-05 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 46/34 ECSubWrite(tid=35, reqid=client.4553.0:267, at_version=46'11, trim_to=0'0, roll_forward_to=45'9))", 2024-09-17T16:42:23.263 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.511954+0000", 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6915776, 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0017503390000000001, 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511954+0000", 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.264 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511954+0000", 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511954+0000", 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0599999999999999e-07 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511981+0000", 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6716999999999998e-05 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.265 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512003+0000", 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1991e-05 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512012+0000", 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7499999999999998e-06 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512088+0000", 2024-09-17T16:42:23.266 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5956000000000003e-05 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512099+0000", 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0307e-05 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.513667+0000", 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001568365 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.267 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.513704+0000", 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7047e-05 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 46/34 ECSubWrite(tid=36, reqid=client.4553.0:268, at_version=46'12, trim_to=0'0, roll_forward_to=45'9))", 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.513995+0000", 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6895358140000001, 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016586420000000001, 2024-09-17T16:42:23.268 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.513995+0000", 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.513995+0000", 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.269 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.513996+0000", 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0800000000000003e-07 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514018+0000", 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1781e-05 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514168+0000", 2024-09-17T16:42:23.270 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015029900000000001 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514180+0000", 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1847e-05 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514239+0000", 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8468999999999999e-05 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.271 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514249+0000", 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9410000000000002e-06 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.515616+0000", 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0013671390000000001 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.515654+0000", 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8257999999999999e-05 2024-09-17T16:42:23.272 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 46/34 ECSubWrite(tid=37, reqid=client.4553.0:269, at_version=46'13, trim_to=0'0, roll_forward_to=45'9))", 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.514239+0000", 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6892924909999998, 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001439086, 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.273 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514239+0000", 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514239+0000", 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.274 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514239+0000", 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3799999999999997e-07 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514256+0000", 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6881e-05 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514265+0000", 2024-09-17T16:42:23.275 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2410000000000001e-06 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514273+0000", 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7719999999999994e-06 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.276 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514593+0000", 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032020600000000002 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.514602+0000", 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5890000000000003e-06 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.515658+0000", 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010561570000000001 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.277 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.515678+0000", 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9701999999999999e-05 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:270 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~655360] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6830956390000003, 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013861503000000001, 2024-09-17T16:42:23.278 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 270 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.279 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520438+0000", 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0849999999999999e-06 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520784+0000", 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034672700000000002 2024-09-17T16:42:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520799+0000", 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4945e-05 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520809+0000", 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999997e-06 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.281 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520888+0000", 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9523000000000004e-05 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.521021+0000", 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013319300000000001 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522568+0000", 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015468770000000001 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.282 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085082820000000007 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534240+0000", 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031634889999999998 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534297+0000", 2024-09-17T16:42:23.283 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:271 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6807005130000001, 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01199191, 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:23.284 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 271 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.285 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522833+0000", 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.889e-06 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523129+0000", 2024-09-17T16:42:23.286 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029651599999999998 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523150+0000", 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0537e-05 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523159+0000", 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2329999999999995e-06 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.287 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527318+0000", 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041587719999999998 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527398+0000", 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0752000000000002e-05 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527918+0000", 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051932300000000003 2024-09-17T16:42:23.288 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531167+0000", 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032495649999999998 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534786+0000", 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036188050000000001 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.289 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534823+0000", 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6517999999999998e-05 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:272 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.680352091, 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011828584, 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.290 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 272 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.291 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523180+0000", 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523184+0000", 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1989999999999999e-06 2024-09-17T16:42:23.292 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523202+0000", 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7932999999999999e-05 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523210+0000", 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5050000000000001e-06 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.293 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530456+0000", 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072466300000000004 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3615999999999995e-05 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530847+0000", 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032758 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.294 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531332+0000", 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048465900000000002 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534949+0000", 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036167159999999999 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535008+0000", 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9038e-05 2024-09-17T16:42:23.295 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:273 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6803092390000001, 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012586701, 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:23.296 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 273 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:23.297 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523223+0000", 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523226+0000", 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2150000000000001e-06 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.298 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:42:23.299 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9100000000000005e-06 2024-09-17T16:42:23.299 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.299 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.299 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.299 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523241+0000", 2024-09-17T16:42:23.300 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1899999999999998e-06 2024-09-17T16:42:23.300 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.300 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.300 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531097+0000", 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078564370000000008 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531159+0000", 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535259+0000", 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041002670000000003 2024-09-17T16:42:23.301 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535355+0000", 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5707999999999999e-05 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535809+0000", 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045409299999999998 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.302 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.3s0 46/34 ECSubWriteReply(tid=19, last_complete=46'12, committed=1, applied=1))", 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.527945+0000", 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 3.6755859339999999, 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031321180000000001, 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527945+0000", 2024-09-17T16:42:23.303 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527945+0000", 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527946+0000", 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7700000000000004e-07 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.304 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527950+0000", 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2130000000000002e-06 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527960+0000", 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8500000000000006e-06 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527966+0000", 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7989999999999999e-06 2024-09-17T16:42:23.305 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531060+0000", 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030939399999999999 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7538999999999999e-05 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:23.306 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:23.307 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:23.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:23.309 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:23.306+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:23.409 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:23.407+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:23.423 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:23.424 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:23.424 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:23.424 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:23.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:23.446 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:42:23.449 INFO:tasks.rados.rados.0.smithi183.stdout:112: done (0 left) 2024-09-17T16:42:23.450 INFO:tasks.rados.rados.0.smithi183.stdout:113: rmattr oid 37 current snap is 9 2024-09-17T16:42:23.450 INFO:tasks.rados.rados.0.smithi183.stdout:113: done (0 left) 2024-09-17T16:42:23.450 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 43 current snap is 9 2024-09-17T16:42:23.450 INFO:tasks.rados.rados.0.smithi183.stdout:114: seq_num 64 ranges {720896=704512,1425408=376832} 2024-09-17T16:42:23.457 INFO:tasks.rados.rados.0.smithi183.stdout:114: writing smithi18337221-43 from 720896 to 1425408 tid 1 2024-09-17T16:42:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:114: writing smithi18337221-43 from 1425408 to 1802240 tid 2 2024-09-17T16:42:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:115: delete oid 42 current snap is 9 2024-09-17T16:42:23.468 INFO:tasks.rados.rados.0.smithi183.stdout:115: done (1 left) 2024-09-17T16:42:23.468 INFO:tasks.rados.rados.0.smithi183.stdout:116: rollback oid 8 current snap is 9 2024-09-17T16:42:23.469 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 8 to 8 2024-09-17T16:42:23.469 INFO:tasks.rados.rados.0.smithi183.stdout:117: copy_from oid 24 from oid 49 current snap is 9 2024-09-17T16:42:23.469 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 3 current snap is 9 2024-09-17T16:42:23.469 INFO:tasks.rados.rados.0.smithi183.stdout:118: seq_num 66 ranges {2064384=737280,2801664=376832} 2024-09-17T16:42:23.483 INFO:tasks.rados.rados.0.smithi183.stdout:118: writing smithi18337221-3 from 2064384 to 2801664 tid 1 2024-09-17T16:42:23.485 INFO:tasks.rados.rados.0.smithi183.stdout:118: writing smithi18337221-3 from 2801664 to 3178496 tid 2 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:119: snap_create 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:116: finishing rollback tid 0 to smithi18337221-8 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:116: finishing rollback tid 1 to smithi18337221-8 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:116: finishing rollback tid 2 to smithi18337221-8 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 8 v 42 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: finishing write tid 1 to smithi18337221-43 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: finishing write tid 2 to smithi18337221-43 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: finishing write tid 3 to smithi18337221-43 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:117: finishing copy_from racing read to smithi18337221-24 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: finishing write tid 4 to smithi18337221-43 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: oid 43 updating version 0 to 12 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: oid 43 version 12 is already newer than 10 2024-09-17T16:42:23.486 INFO:tasks.rados.rados.0.smithi183.stdout:114: oid 43 version 12 is already newer than 11 2024-09-17T16:42:23.487 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 12 (ObjNum 64 snap 9 seq_num 64) dirty exists 2024-09-17T16:42:23.487 INFO:tasks.rados.rados.0.smithi183.stdout:114: left oid 43 (ObjNum 64 snap 9 seq_num 64) 2024-09-17T16:42:23.487 INFO:tasks.rados.rados.0.smithi183.stdout:117: finishing copy_from to smithi18337221-24 2024-09-17T16:42:23.487 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 24 v 7 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-09-17T16:42:23.494 INFO:tasks.rados.rados.0.smithi183.stdout:118: finishing write tid 1 to smithi18337221-3 2024-09-17T16:42:23.497 INFO:tasks.rados.rados.0.smithi183.stdout:118: finishing write tid 2 to smithi18337221-3 2024-09-17T16:42:23.497 INFO:tasks.rados.rados.0.smithi183.stdout:118: finishing write tid 3 to smithi18337221-3 2024-09-17T16:42:23.498 INFO:tasks.rados.rados.0.smithi183.stdout:118: finishing write tid 4 to smithi18337221-3 2024-09-17T16:42:23.498 INFO:tasks.rados.rados.0.smithi183.stdout:118: oid 3 updating version 0 to 18 2024-09-17T16:42:23.498 INFO:tasks.rados.rados.0.smithi183.stdout:118: oid 3 version 18 is already newer than 16 2024-09-17T16:42:23.499 INFO:tasks.rados.rados.0.smithi183.stdout:118: oid 3 version 18 is already newer than 17 2024-09-17T16:42:23.499 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 3 v 18 (ObjNum 66 snap 9 seq_num 66) dirty exists 2024-09-17T16:42:23.499 INFO:tasks.rados.rados.0.smithi183.stdout:118: left oid 3 (ObjNum 66 snap 9 seq_num 66) 2024-09-17T16:42:23.510 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:23.508+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:23.548 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:23.548 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:23.548 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:23.548 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:23.548 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:23.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:23.611 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:23.608+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:23.666 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:23.666 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:23.666 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.8.21:1 3.6s0 3:636772f7:::smithi18337221-13:head [assert-version v2,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.461263+0000", 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.201775512999999, 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036209889999999998, 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461263+0000", 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461263+0000", 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.668 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461264+0000", 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.358e-06 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461278+0000", 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3592e-05 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461287+0000", 2024-09-17T16:42:23.669 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0529999999999996e-06 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461295+0000", 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2949999999999994e-06 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461358+0000", 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3132000000000005e-05 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.670 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.461364+0000", 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8100000000000003e-06 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.463792+0000", 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0024279369999999998 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.463841+0000", 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8683000000000001e-05 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.464884+0000", 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010431290000000001 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.9s2 40/34 ECSubRead(tid=21, to_read={3:97a3b59a:::smithi18337221-19:head=0,77824,0}, subchunks={3:97a3b59a:::smithi18337221-19:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.480872+0000", 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.182165909, 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038055860000000001, 2024-09-17T16:42:23.672 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480872+0000", 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480872+0000", 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480873+0000", 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8899999999999998e-07 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480887+0000", 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3575e-05 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480915+0000", 2024-09-17T16:42:23.674 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8438000000000001e-05 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480926+0000", 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0719e-05 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484546+0000", 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00361977 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484678+0000", 2024-09-17T16:42:23.675 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013219499999999999 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.486547+0000", 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.176490849, 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010340936, 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.676 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486547+0000", 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486547+0000", 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486548+0000", 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0699999999999999e-07 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486676+0000", 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012826800000000001 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.678 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486687+0000", 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1174e-05 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486697+0000", 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4900000000000006e-06 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487645+0000", 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000948182 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487659+0000", 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4504e-05 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.496859+0000", 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0091996579999999994 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.680 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.496888+0000", 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9453000000000001e-05 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:209 3.6s0 3:6d4c68b4:::smithi18337221-35:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.172569819, 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019587552000000001, 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.681 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:23.682 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:23.682 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:23.682 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.682 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 209 2024-09-17T16:42:23.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.682 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.683 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490471+0000", 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.492e-06 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490480+0000", 2024-09-17T16:42:23.684 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490502+0000", 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2005e-05 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490512+0000", 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0129000000000001e-05 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490586+0000", 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4232000000000003e-05 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:23.686 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490679+0000", 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2909000000000001e-05 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497687+0000", 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070084520000000001 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.687 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506016+0000", 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0083282830000000006 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509967+0000", 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039514509999999999 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510056+0000", 2024-09-17T16:42:23.688 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8918000000000005e-05 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:210 3.6s0 3:6d4c68b4:::smithi18337221-35:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490537+0000", 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.172501166, 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014546737000000001, 2024-09-17T16:42:23.689 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.690 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:23.690 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:23.690 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:23.690 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 210 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490537+0000", 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490537+0000", 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490538+0000", 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0299999999999998e-07 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.692 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490542+0000", 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6739999999999999e-06 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490553+0000", 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1688999999999999e-05 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490560+0000", 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0530000000000001e-06 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491012+0000", 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045173499999999998 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491062+0000", 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9969000000000002e-05 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.694 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504876+0000", 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013814214 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504982+0000", 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010611 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505084+0000", 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010149000000000001 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.172404044, 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018101223999999999, 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.696 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490635+0000", 2024-09-17T16:42:23.697 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492045+0000", 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001410644 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492086+0000", 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0726999999999998e-05 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.698 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492098+0000", 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2163e-05 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492226+0000", 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012778900000000001 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492241+0000", 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4932e-05 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508691+0000", 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016449693000000001 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508735+0000", 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4768999999999998e-05 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.7s3 40/34 ECSubRead(tid=64, to_read={3:edf9cac5:::smithi18337221-37:head=0,151552,0}, subchunks={3:edf9cac5:::smithi18337221-37:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.492560+0000", 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.170478036, 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038352709999999999, 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492560+0000", 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.702 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492560+0000", 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492561+0000", 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0800000000000004e-07 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492570+0000", 2024-09-17T16:42:23.703 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1530000000000003e-06 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492589+0000", 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9046999999999999e-05 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492617+0000", 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7328999999999999e-05 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.704 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495855+0000", 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003238407 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.496396+0000", 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054052699999999996 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.7s3 40/34 ECSubRead(tid=66, to_read={3:edf9cac5:::smithi18337221-37:head=0,151552,0}, subchunks={3:edf9cac5:::smithi18337221-37:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.493888+0000", 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.169149857000001, 2024-09-17T16:42:23.705 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029701979999999998, 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493888+0000", 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.706 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493888+0000", 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493889+0000", 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2e-07 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493907+0000", 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8346e-05 2024-09-17T16:42:23.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493918+0000", 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.084e-05 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493927+0000", 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6160000000000002e-06 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.496746+0000", 2024-09-17T16:42:23.708 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028191959999999999 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.496859+0000", 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011278 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.499697+0000", 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.163341313, 2024-09-17T16:42:23.709 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090851690000000006, 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499697+0000", 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.710 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499697+0000", 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499698+0000", 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2389999999999999e-06 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499727+0000", 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8637e-05 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499748+0000", 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0658000000000001e-05 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499758+0000", 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0152e-05 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501064+0000", 2024-09-17T16:42:23.712 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013064229999999999 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501073+0000", 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0329999999999997e-06 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508745+0000", 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076717069999999998 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508782+0000", 2024-09-17T16:42:23.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7320000000000002e-05 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.499844+0000", 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.163194287, 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0094540509999999998, 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.714 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499844+0000", 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499844+0000", 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499845+0000", 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0900000000000002e-07 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499947+0000", 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010228700000000001 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499962+0000", 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5019e-05 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.499970+0000", 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7570000000000004e-06 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504143+0000", 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041735729999999999 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504153+0000", 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8220000000000002e-06 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509258+0000", 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051046429999999999 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509298+0000", 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0441000000000001e-05 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.500014+0000", 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.163024721999999, 2024-09-17T16:42:23.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0060468299999999996, 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500014+0000", 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500014+0000", 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500014+0000", 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0200000000000002e-07 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500109+0000", 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5268999999999999e-05 2024-09-17T16:42:23.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500122+0000", 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2527999999999999e-05 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500129+0000", 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1420000000000004e-06 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500546+0000", 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041705799999999999 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.500557+0000", 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1062e-05 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506023+0000", 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0054655210000000001 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506060+0000", 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7747999999999998e-05 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=15, reqid=client.4553.0:207, at_version=40'13, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.506360+0000", 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.156678360000001, 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034111509999999999, 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.725 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506360+0000", 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506360+0000", 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506361+0000", 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3900000000000004e-07 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506379+0000", 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7818000000000001e-05 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506394+0000", 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5201000000000001e-05 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506402+0000", 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4530000000000002e-06 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508490+0000", 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002087916 2024-09-17T16:42:23.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508499+0000", 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9430000000000006e-06 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509736+0000", 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012370790000000001 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509771+0000", 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4901999999999999e-05 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 40/34 ECSubWrite(tid=73, reqid=client.4553.0:197, at_version=40'19, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.512810+0000", 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.150228483999999, 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003539585, 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512810+0000", 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512810+0000", 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512811+0000", 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1039999999999999e-06 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512869+0000", 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8012e-05 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512886+0000", 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7028e-05 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512905+0000", 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8793000000000001e-05 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512961+0000", 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6711e-05 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512970+0000", 2024-09-17T16:42:23.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8370000000000003e-06 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516302+0000", 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003331554 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516349+0000", 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7546000000000002e-05 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.734 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:221 3.6s0 3.802138f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.470358+0000", 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.1926798979999997, 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052946390000000003, 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 221 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470358+0000", 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470358+0000", 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470361+0000", 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8550000000000002e-06 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470401+0000", 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9660999999999999e-05 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470421+0000", 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0358000000000001e-05 2024-09-17T16:42:23.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470437+0000", 2024-09-17T16:42:23.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5512999999999999e-05 2024-09-17T16:42:23.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470520+0000", 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3400999999999997e-05 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470527+0000", 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3330000000000002e-06 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475636+0000", 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051099079999999998 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475653+0000", 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6609999999999999e-05 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.740 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:222 3.6s0 3.802138f6 (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.470472+0000", 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.19256648, 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052057429999999997, 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 222 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470472+0000", 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470472+0000", 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470473+0000", 2024-09-17T16:42:23.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7599999999999996e-07 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470480+0000", 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4580000000000004e-06 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470491+0000", 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0781000000000001e-05 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470497+0000", 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5560000000000004e-06 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470600+0000", 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010275700000000001 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.470609+0000", 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2779999999999999e-06 2024-09-17T16:42:23.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475671+0000", 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0050617090000000002 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475678+0000", 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4280000000000001e-06 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:221 3.6s0 3:6f1c8401:::smithi18337221-16:head [copy-from ver 2] snapc 4=[4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.1917686120000006, 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014566234000000001, 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.746 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 221 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471271+0000", 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1039999999999999e-06 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471276+0000", 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.378e-06 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471289+0000", 2024-09-17T16:42:23.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2612999999999999e-05 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471301+0000", 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2046e-05 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471355+0000", 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4512999999999998e-05 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471361+0000", 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0549999999999996e-06 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475700+0000", 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004338789 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475828+0000", 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012755000000000001 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.481497+0000", 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056689610000000001 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483484+0000", 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019870399999999998 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.485768+0000", 2024-09-17T16:42:23.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022843389999999998 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.485836+0000", 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7846000000000001e-05 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.752 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:222 3.6s0 3:6f1c8401:::smithi18337221-16:head [stat] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.471318+0000", 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.1917199600000004, 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011886663, 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 222 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471318+0000", 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471318+0000", 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471319+0000", 2024-09-17T16:42:23.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8899999999999999e-07 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471322+0000", 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.88e-06 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471330+0000", 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2600000000000005e-06 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471336+0000", 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8690000000000001e-06 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471400+0000", 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4542999999999995e-05 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471407+0000", 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4219999999999997e-06 2024-09-17T16:42:23.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.476024+0000", 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004617487 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.476081+0000", 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6563e-05 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483052+0000", 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069706120000000002 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483135+0000", 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3628999999999995e-05 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483205+0000", 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9808999999999995e-05 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.9s2 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:18.508136+0000", 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 5.1549026639999997, 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052726479999999996, 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508136+0000", 2024-09-17T16:42:23.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508136+0000", 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508136+0000", 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7300000000000002e-07 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508549+0000", 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041269800000000003 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508562+0000", 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3056e-05 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508571+0000", 2024-09-17T16:42:23.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6010000000000001e-06 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508631+0000", 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9428000000000001e-05 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508637+0000", 2024-09-17T16:42:23.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6499999999999999e-06 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.513379+0000", 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0047410910000000002 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.513408+0000", 2024-09-17T16:42:23.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9751e-05 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 50/34 ECSubWrite(tid=94, reqid=client.4553.0:291, at_version=50'25, trim_to=0'0, roll_forward_to=42'23))", 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461429+0000", 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.201609503, 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029800500000000001, 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461429+0000", 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461429+0000", 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461429+0000", 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.48e-07 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461465+0000", 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5852000000000002e-05 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461480+0000", 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5546e-05 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461493+0000", 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3010000000000001e-05 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461575+0000", 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1864000000000001e-05 2024-09-17T16:42:23.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461588+0000", 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2379e-05 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.464377+0000", 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002789246 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.464409+0000", 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1905e-05 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.473504+0000", 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.18953404900000001, 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0062731469999999998, 2024-09-17T16:42:23.769 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473504+0000", 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473504+0000", 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473506+0000", 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6819999999999999e-06 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473673+0000", 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016713599999999999 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:23.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473690+0000", 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7204999999999999e-05 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473702+0000", 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.182e-05 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473827+0000", 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012477000000000001 2024-09-17T16:42:23.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473838+0000", 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1037e-05 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479735+0000", 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058966410000000002 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:23.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479777+0000", 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2855999999999998e-05 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:23.774 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:23.776 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:23.776 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:23.774+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:23.877 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:23.875+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:23.925 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:23.925 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:23.925 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:23.925 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:23.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:23.978 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:23.975+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:24.081 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:24.081 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:24.081 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:24.081 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:24.081 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:24.081 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:24.078+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:24.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:24.182 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:24.180+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:24.197 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.719127706, 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:24.198 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:24.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:42:24.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:24.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:42:24.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:42:24.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:24.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:42:24.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:42:24.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:42:24.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:42:24.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.207 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.207 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.208 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.208 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:24.208 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.717194953, 2024-09-17T16:42:24.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:42:24.208 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.208 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.209 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:24.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:42:24.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.212 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:24.213 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:42:24.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:42:24.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:42:24.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:42:24.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:24.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:42:24.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:42:24.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:24.220 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.716767962, 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.221 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.222 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:42:24.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.222 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:24.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.716734497999999, 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.229 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:24.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:42:24.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:24.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:42:24.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:42:24.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:42:24.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:42:24.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.716688191999999, 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:42:24.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:24.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:42:24.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:42:24.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:42:24.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:42:24.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:42:24.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.716628339, 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.246 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:42:24.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:24.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.5.23:2 3.bs0 3:d08ffbb6:::smithi18337221-30:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:24.253 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.711357897999999, 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025206989999999999, 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483332+0000", 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9630000000000001e-06 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483339+0000", 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483351+0000", 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483359+0000", 2024-09-17T16:42:24.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506020+0000", 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022660777 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506121+0000", 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010158999999999999 2024-09-17T16:42:24.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508537+0000", 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002415848 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.260 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:24.260 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:24.260 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.706697731, 2024-09-17T16:42:24.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016316462, 2024-09-17T16:42:24.260 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487992+0000", 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1400000000000001e-06 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487999+0000", 2024-09-17T16:42:24.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1459999999999999e-06 2024-09-17T16:42:24.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488012+0000", 2024-09-17T16:42:24.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3499000000000001e-05 2024-09-17T16:42:24.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488021+0000", 2024-09-17T16:42:24.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6519999999999995e-06 2024-09-17T16:42:24.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504215+0000", 2024-09-17T16:42:24.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016193754000000001 2024-09-17T16:42:24.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504307+0000", 2024-09-17T16:42:24.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2270999999999998e-05 2024-09-17T16:42:24.266 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.705947412, 2024-09-17T16:42:24.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01555453, 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:24.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:24.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488742+0000", 2024-09-17T16:42:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7899999999999997e-07 2024-09-17T16:42:24.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488747+0000", 2024-09-17T16:42:24.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3759999999999999e-06 2024-09-17T16:42:24.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488766+0000", 2024-09-17T16:42:24.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8739000000000001e-05 2024-09-17T16:42:24.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488775+0000", 2024-09-17T16:42:24.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1889999999999996e-06 2024-09-17T16:42:24.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504279+0000", 2024-09-17T16:42:24.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015503576 2024-09-17T16:42:24.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504295+0000", 2024-09-17T16:42:24.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6770999999999999e-05 2024-09-17T16:42:24.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.275 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.276 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:24.276 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:24.276 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.705863347999999, 2024-09-17T16:42:24.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015687293000000001, 2024-09-17T16:42:24.276 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.277 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.277 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.277 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488826+0000", 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488829+0000", 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9589999999999997e-06 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488839+0000", 2024-09-17T16:42:24.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6840000000000008e-06 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488845+0000", 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504490+0000", 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015645032 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504512+0000", 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1790999999999999e-05 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.281 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.489903+0000", 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.704784917, 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014554675, 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489903+0000", 2024-09-17T16:42:24.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489903+0000", 2024-09-17T16:42:24.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489905+0000", 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.266e-06 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489912+0000", 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9739999999999996e-06 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489926+0000", 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4256999999999999e-05 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489934+0000", 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.551e-06 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504428+0000", 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014493259 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504458+0000", 2024-09-17T16:42:24.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0368000000000001e-05 2024-09-17T16:42:24.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.288 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:211 3.1s0 3:8551e558:::smithi18337221-41:head [read 443262~244866,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.489981+0000", 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.704707567, 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012068693, 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.289 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 211 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489981+0000", 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489981+0000", 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489982+0000", 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.818e-06 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489989+0000", 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8759999999999999e-06 2024-09-17T16:42:24.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490006+0000", 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6592e-05 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490013+0000", 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.182e-06 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490082+0000", 2024-09-17T16:42:24.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8443999999999997e-05 2024-09-17T16:42:24.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490182+0000", 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100441 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502049+0000", 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011867340000000001 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:212 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.704084687, 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014567019, 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.295 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 212 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:24.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490605+0000", 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.074e-06 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490610+0000", 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8370000000000002e-06 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490626+0000", 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.571e-05 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490645+0000", 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8952000000000001e-05 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490964+0000", 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031921400000000001 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491049+0000", 2024-09-17T16:42:24.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4197999999999996e-05 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505171+0000", 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014122034 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:213 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.300 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.704028186, 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017648329000000001, 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 213 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.301 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490661+0000", 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490665+0000", 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1010000000000002e-06 2024-09-17T16:42:24.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490675+0000", 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0467e-05 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490681+0000", 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8939999999999998e-06 2024-09-17T16:42:24.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492163+0000", 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001481794 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492244+0000", 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0897999999999997e-05 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508308+0000", 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016064544 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:216 3.7s0 3:edf9cac5:::smithi18337221-37:2 [read 0~606208,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.702979668999999, 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068160599999999997, 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 216 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.307 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491709+0000", 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9699999999999995e-07 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491716+0000", 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1890000000000001e-06 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491730+0000", 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3526000000000001e-05 2024-09-17T16:42:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491737+0000", 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6390000000000003e-06 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013769539999999999 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493193+0000", 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9714000000000003e-05 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498525+0000", 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053313409999999999 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 39/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.494015+0000", 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.700673266999999, 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010569123999999999, 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494015+0000", 2024-09-17T16:42:24.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494015+0000", 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494016+0000", 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7199999999999997e-07 2024-09-17T16:42:24.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494021+0000", 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0019999999999997e-06 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494032+0000", 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1620999999999999e-05 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494041+0000", 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4400000000000005e-06 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504559+0000", 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010517761 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504584+0000", 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5428000000000001e-05 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.316 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.697683441000001, 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078633430000000001, 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497005+0000", 2024-09-17T16:42:24.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3099999999999997e-07 2024-09-17T16:42:24.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497011+0000", 2024-09-17T16:42:24.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2079999999999999e-06 2024-09-17T16:42:24.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497022+0000", 2024-09-17T16:42:24.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1721e-05 2024-09-17T16:42:24.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.322 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497038+0000", 2024-09-17T16:42:24.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6004000000000001e-05 2024-09-17T16:42:24.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.322 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504650+0000", 2024-09-17T16:42:24.323 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076114149999999998 2024-09-17T16:42:24.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504868+0000", 2024-09-17T16:42:24.324 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000218264 2024-09-17T16:42:24.324 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.324 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.324 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.325 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:295 3.bs0 3:d855b096:::smithi18337221-24:head [copy-from ver 7] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:24.325 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:24.325 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.72939531300000005, 2024-09-17T16:42:24.325 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016204202000000001, 2024-09-17T16:42:24.325 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.326 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:24.326 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.326 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.326 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.327 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 295 2024-09-17T16:42:24.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.327 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:24.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.328 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.328 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.328 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:24.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465294+0000", 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.451e-06 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465300+0000", 2024-09-17T16:42:24.330 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6659999999999996e-06 2024-09-17T16:42:24.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465314+0000", 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4443e-05 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465322+0000", 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.52e-06 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465665+0000", 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034335499999999999 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465770+0000", 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104732 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473519+0000", 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077493609999999997 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479834+0000", 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063149369999999996 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481444+0000", 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0016096330000000001 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481497+0000", 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3103999999999998e-05 2024-09-17T16:42:24.334 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.335 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.335 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.335 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:296 3.bs0 3:d855b096:::smithi18337221-24:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:24.335 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.465353+0000", 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.72933486000000003, 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014356077, 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 296 2024-09-17T16:42:24.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465353+0000", 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465353+0000", 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465354+0000", 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0699999999999997e-07 2024-09-17T16:42:24.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465357+0000", 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4979999999999998e-06 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465379+0000", 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1702e-05 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.339 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465392+0000", 2024-09-17T16:42:24.340 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3159000000000001e-05 2024-09-17T16:42:24.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465950+0000", 2024-09-17T16:42:24.341 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00055752799999999995 2024-09-17T16:42:24.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465998+0000", 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8278000000000001e-05 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479481+0000", 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013482579 2024-09-17T16:42:24.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479606+0000", 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012574600000000001 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479709+0000", 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010298000000000001 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.3s2 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.485106+0000", 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.70958202800000003, 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077757770000000002, 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.485106+0000", 2024-09-17T16:42:24.345 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.485106+0000", 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.485106+0000", 2024-09-17T16:42:24.346 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1999999999999999e-07 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.486039+0000", 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00093282499999999997 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.486048+0000", 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1479999999999995e-06 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.486053+0000", 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0259999999999998e-06 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.486093+0000", 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9709999999999998e-05 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.486098+0000", 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3839999999999996e-06 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.492854+0000", 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006755217 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.492882+0000", 2024-09-17T16:42:24.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8347000000000002e-05 2024-09-17T16:42:24.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.350 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.350 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.350 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.350 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:24.352 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:24.353 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:24.349+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:24.452 INFO:tasks.rados.rados.0.smithi183.stdout:114: done (4 left) 2024-09-17T16:42:24.452 INFO:tasks.rados.rados.0.smithi183.stdout:116: done (3 left) 2024-09-17T16:42:24.452 INFO:tasks.rados.rados.0.smithi183.stdout:117: done (2 left) 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:118: done (1 left) 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:119: done (0 left) 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:120: read oid 19 snap 6 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:120: expect (ObjNum 59 snap 4 seq_num 59) 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:121: read oid 18 snap 7 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:121: expect (ObjNum 17 snap 0 seq_num 17) 2024-09-17T16:42:24.453 INFO:tasks.rados.rados.0.smithi183.stdout:122: snap_remove snap 8 2024-09-17T16:42:24.454 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:24.450+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:24.502 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:24.502 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:24.503 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:24.511 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:24.553 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:24.551+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:24.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:24.654 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:24.652+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:24.659 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:24.659 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:24.660 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:24.660 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:24.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:24.755 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:24.753+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:178 3.4s0 3:216603c8:::smithi18337221-7:head [copy-from ver 2] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:24.819 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.355786396999999, 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0097627789999999992, 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 178 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.820 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460520+0000", 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3209999999999999e-06 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460526+0000", 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4590000000000003e-06 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460539+0000", 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2634e-05 2024-09-17T16:42:24.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460546+0000", 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0450000000000003e-06 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460588+0000", 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1984999999999999e-05 2024-09-17T16:42:24.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460652+0000", 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4475999999999997e-05 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.825 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.466465+0000", 2024-09-17T16:42:24.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058132269999999998 2024-09-17T16:42:24.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.825 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469088+0000", 2024-09-17T16:42:24.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026224709999999999 2024-09-17T16:42:24.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:24.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470220+0000", 2024-09-17T16:42:24.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001132248 2024-09-17T16:42:24.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470281+0000", 2024-09-17T16:42:24.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0912999999999998e-05 2024-09-17T16:42:24.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.829 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:179 3.4s0 3:216603c8:::smithi18337221-7:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:24.830 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:24.830 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 12.355746292999999, 2024-09-17T16:42:24.830 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084466430000000002, 2024-09-17T16:42:24.830 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.830 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.831 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.831 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.831 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.831 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 179 2024-09-17T16:42:24.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.832 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.832 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.832 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:24.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.833 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.833 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:24.833 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.834 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.834 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460559+0000", 2024-09-17T16:42:24.834 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6800000000000001e-07 2024-09-17T16:42:24.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.835 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.835 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460562+0000", 2024-09-17T16:42:24.835 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5410000000000001e-06 2024-09-17T16:42:24.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.836 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.836 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460569+0000", 2024-09-17T16:42:24.836 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2160000000000003e-06 2024-09-17T16:42:24.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.837 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.837 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460576+0000", 2024-09-17T16:42:24.837 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1230000000000002e-06 2024-09-17T16:42:24.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.838 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460781+0000", 2024-09-17T16:42:24.838 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00020571599999999999 2024-09-17T16:42:24.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.838 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460810+0000", 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8632999999999998e-05 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468798+0000", 2024-09-17T16:42:24.839 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0079879180000000001 2024-09-17T16:42:24.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.840 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.840 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468900+0000", 2024-09-17T16:42:24.840 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000101611 2024-09-17T16:42:24.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.841 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.841 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469005+0000", 2024-09-17T16:42:24.841 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105417 2024-09-17T16:42:24.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.843 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:199 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 764485~497083,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.843 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:24.843 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.338490543000001, 2024-09-17T16:42:24.843 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010265850999999999, 2024-09-17T16:42:24.843 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.844 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.844 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.844 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.844 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.844 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 199 2024-09-17T16:42:24.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.845 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.845 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.845 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:24.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.846 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.846 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:24.846 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.847 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.847 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477816+0000", 2024-09-17T16:42:24.847 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8530000000000001e-06 2024-09-17T16:42:24.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.848 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.848 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477825+0000", 2024-09-17T16:42:24.848 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8850000000000005e-06 2024-09-17T16:42:24.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.849 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.849 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477841+0000", 2024-09-17T16:42:24.849 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6070999999999999e-05 2024-09-17T16:42:24.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.850 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.850 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477851+0000", 2024-09-17T16:42:24.850 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0261999999999999e-05 2024-09-17T16:42:24.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.851 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477947+0000", 2024-09-17T16:42:24.851 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5457000000000004e-05 2024-09-17T16:42:24.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.851 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477956+0000", 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9639999999999992e-06 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480792+0000", 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028365840000000001 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480879+0000", 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7130000000000001e-05 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488080+0000", 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072006450000000003 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:200 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.338425291, 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011662507000000001, 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 200 2024-09-17T16:42:24.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.855 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:24.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477880+0000", 2024-09-17T16:42:24.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8599999999999998e-07 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477886+0000", 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5740000000000001e-06 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477906+0000", 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9604000000000001e-05 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477914+0000", 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5859999999999999e-06 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478028+0000", 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011431500000000001 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478034+0000", 2024-09-17T16:42:24.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0530000000000003e-06 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481597+0000", 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035624699999999999 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481685+0000", 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8129999999999998e-05 2024-09-17T16:42:24.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489542+0000", 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078571890000000005 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:201 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:24.860 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.338375625999999, 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013839093, 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 201 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.861 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477930+0000", 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1189999999999999e-06 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477949+0000", 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1701e-05 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477955+0000", 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6529999999999997e-06 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121858 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478083+0000", 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7150000000000003e-06 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482035+0000", 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039517290000000002 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482114+0000", 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9499000000000006e-05 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491768+0000", 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096540259999999996 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.334717231999999, 2024-09-17T16:42:24.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082527759999999999, 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481588+0000", 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.41e-07 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481637+0000", 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9536999999999997e-05 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481649+0000", 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1718e-05 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481658+0000", 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0589999999999992e-06 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482410+0000", 2024-09-17T16:42:24.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00075179700000000001 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482422+0000", 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1980999999999999e-05 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489809+0000", 2024-09-17T16:42:24.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073877420000000001 2024-09-17T16:42:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489840+0000", 2024-09-17T16:42:24.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0701000000000003e-05 2024-09-17T16:42:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.873 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.4s0 40/34 ECSubRead(tid=20, to_read={3:2affd2d4:::smithi18337221-25:head=0,315392,0}, subchunks={3:2affd2d4:::smithi18337221-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.334354289, 2024-09-17T16:42:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0041210780000000002, 2024-09-17T16:42:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:24.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481950+0000", 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484083+0000", 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0021322260000000001 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484095+0000", 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2067e-05 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484953+0000", 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00085798099999999996 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486071+0000", 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011188039999999999 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpRead(3.4s0 40/34 ECSubRead(tid=21, to_read={3:2affd2d4:::smithi18337221-25:head=0,315392,0}, subchunks={3:2affd2d4:::smithi18337221-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.333969827000001, 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040410029999999996, 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:24.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484140+0000", 2024-09-17T16:42:24.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018050950000000001 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484171+0000", 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1547000000000001e-05 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486269+0000", 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0020975120000000002 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486376+0000", 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010684900000000001 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.886 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.333547152, 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071068959999999997, 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.887 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482758+0000", 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482780+0000", 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1294e-05 2024-09-17T16:42:24.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482790+0000", 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0736e-05 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482801+0000", 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0474e-05 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482990+0000", 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00018943399999999999 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483000+0000", 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4259999999999992e-06 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489844+0000", 2024-09-17T16:42:24.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068445470000000003 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489864+0000", 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9993999999999999e-05 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=19, attrs_read=0))", 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:24.893 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.333532801, 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053380830000000004, 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482772+0000", 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484196+0000", 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014242460000000001 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484201+0000", 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3489999999999999e-06 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487501+0000", 2024-09-17T16:42:24.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0032999800000000001 2024-09-17T16:42:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488110+0000", 2024-09-17T16:42:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00060850800000000001 2024-09-17T16:42:24.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:24.900 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.333104289, 2024-09-17T16:42:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066866139999999996, 2024-09-17T16:42:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.901 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483201+0000", 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1090000000000001e-06 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483218+0000", 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6175999999999999e-05 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483230+0000", 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2149e-05 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483236+0000", 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4740000000000002e-06 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483520+0000", 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028360700000000001 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483531+0000", 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489867+0000", 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063354129999999998 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489887+0000", 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0285e-05 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=20, attrs_read=0))", 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.484329+0000", 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.331975604, 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003057831, 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484329+0000", 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484329+0000", 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484330+0000", 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5599999999999995e-07 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484586+0000", 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00025627199999999999 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484598+0000", 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2306e-05 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484605+0000", 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4489999999999996e-06 2024-09-17T16:42:24.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486466+0000", 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018610740000000001 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487387+0000", 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00092117399999999997 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.331687092999999, 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0036275449999999998, 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:24.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484618+0000", 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.82e-07 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484865+0000", 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00024668800000000001 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484874+0000", 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9819999999999997e-06 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.484879+0000", 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5629999999999999e-06 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488201+0000", 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033221190000000001 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488245+0000", 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3711000000000002e-05 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.915 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 40/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.329941844, 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033720019999999998, 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486363+0000", 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486383+0000", 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.978e-05 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486389+0000", 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2709999999999998e-06 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489692+0000", 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033035220000000001 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489735+0000", 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2429000000000003e-05 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpReadReply(3.4s0 39/34 ECSubReadReply(tid=21, attrs_read=0))", 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.486487+0000", 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.329817275, 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053116750000000001, 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486487+0000", 2024-09-17T16:42:24.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486487+0000", 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.486488+0000", 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7899999999999999e-07 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489932+0000", 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034442090000000002 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489961+0000", 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9081000000000002e-05 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489970+0000", 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7590000000000003e-06 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490022+0000", 2024-09-17T16:42:24.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1820999999999997e-05 2024-09-17T16:42:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491799+0000", 2024-09-17T16:42:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0017773260000000001 2024-09-17T16:42:24.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:24.925 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.322916743, 2024-09-17T16:42:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096456860000000005, 2024-09-17T16:42:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493389+0000", 2024-09-17T16:42:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.057e-06 2024-09-17T16:42:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495399+0000", 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002010529 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495410+0000", 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0983e-05 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495418+0000", 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0120000000000005e-06 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495585+0000", 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000166274 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495592+0000", 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5580000000000003e-06 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502976+0000", 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073836580000000004 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503034+0000", 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7615000000000003e-05 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.510782+0000", 2024-09-17T16:42:24.934 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.305522756, 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0050245639999999996, 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510782+0000", 2024-09-17T16:42:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510782+0000", 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510783+0000", 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.446e-06 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511133+0000", 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034976799999999998 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511155+0000", 2024-09-17T16:42:24.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1929e-05 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511167+0000", 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1549000000000001e-05 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511264+0000", 2024-09-17T16:42:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7739999999999996e-05 2024-09-17T16:42:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511275+0000", 2024-09-17T16:42:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1077000000000001e-05 2024-09-17T16:42:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515755+0000", 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044798540000000001 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515806+0000", 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1201e-05 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.942 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.943 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.9s5 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:18.507863+0000", 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 6.3084412560000001, 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053598550000000002, 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.944 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.507863+0000", 2024-09-17T16:42:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.507863+0000", 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.507864+0000", 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8699999999999995e-07 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508241+0000", 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00037673399999999999 2024-09-17T16:42:24.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508251+0000", 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.081e-05 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508260+0000", 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1329999999999999e-06 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508323+0000", 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3238999999999995e-05 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.508334+0000", 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1202e-05 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.513192+0000", 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0048582390000000003 2024-09-17T16:42:24.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:18.513223+0000", 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0911000000000003e-05 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:24.949 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.3551685440000001, 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010978876, 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462292+0000", 2024-09-17T16:42:24.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001155611 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462308+0000", 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6039e-05 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462318+0000", 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3989999999999993e-06 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462380+0000", 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2589999999999995e-05 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462390+0000", 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0020999999999999e-05 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472076+0000", 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096855420000000001 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472115+0000", 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9242999999999997e-05 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 50/34 ECSubWrite(tid=112, reqid=client.4553.0:288, at_version=50'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.468246+0000", 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.3480585700000001, 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042554589999999996, 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:24.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468246+0000", 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468246+0000", 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468255+0000", 2024-09-17T16:42:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7090000000000008e-06 2024-09-17T16:42:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468368+0000", 2024-09-17T16:42:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000113689 2024-09-17T16:42:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468382+0000", 2024-09-17T16:42:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3138e-05 2024-09-17T16:42:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468392+0000", 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0124e-05 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468569+0000", 2024-09-17T16:42:24.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000176918 2024-09-17T16:42:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.468578+0000", 2024-09-17T16:42:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0780000000000002e-06 2024-09-17T16:42:24.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472457+0000", 2024-09-17T16:42:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038795140000000001 2024-09-17T16:42:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:24.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472501+0000", 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4289000000000002e-05 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:24.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:24.963 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:24.965 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:24.962+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:24.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:24.966 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:24.970 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:24.987 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:24.988 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:25.005 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:25.005 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:25.021 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:25.021 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:25.039 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:25.039 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:25.057 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:25.057 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:25.065 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:25.063+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:25.074 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:25.074 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:25.075 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:25.075 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:25.075 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:25.084 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:25.092 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:25.092 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:25.109 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:25.110 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:25.127 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:25.144 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:25.144 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:25.161 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:25.162 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:25.166 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:25.164+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:25.179 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:25.179 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:25.197 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:25.197 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:25.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:25.195+0000 7f7d26683640 0 -- 172.21.15.60:0/1592870907 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f7d20223e80 msgr2=0x7f7d20226270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:25.201 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:25.201 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:25.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:25.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:25.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:25.266 INFO:tasks.thrashosds.thrasher:inject_pause on osd.15 2024-09-17T16:42:25.266 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T16:42:25.266 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T16:42:25.267 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok config set filestore_inject_stall 3 2024-09-17T16:42:25.267 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:25.265+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:25.359 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:25.360 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:25.368 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:25.369 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:25.366+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:25.382 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:25.382 INFO:teuthology.orchestra.run.smithi183.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T16:42:25.382 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:25.416 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:25.416 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:25.438 INFO:tasks.rados.rados.0.smithi183.stdout:122: done (2 left) 2024-09-17T16:42:25.438 INFO:tasks.rados.rados.0.smithi183.stdout:123: read oid 28 snap -1 2024-09-17T16:42:25.439 INFO:tasks.rados.rados.0.smithi183.stdout:123: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:25.439 INFO:tasks.rados.rados.0.smithi183.stdout:124: rollback oid 46 current snap is 10 2024-09-17T16:42:25.439 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 46 to 9 2024-09-17T16:42:25.439 INFO:tasks.rados.rados.0.smithi183.stdout:120: expect (ObjNum 59 snap 4 seq_num 59) 2024-09-17T16:42:25.439 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.454 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:42:25.470 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 382462 2024-09-17T16:42:25.479 INFO:tasks.rados.rados.0.smithi183.stdout:121: expect (ObjNum 17 snap 0 seq_num 17) 2024-09-17T16:42:25.479 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.481 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.484 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.487 INFO:tasks.rados.rados.0.smithi183.stdout:124: finishing rollback tid 0 to smithi18337221-46 2024-09-17T16:42:25.487 INFO:tasks.rados.rados.0.smithi183.stdout:124: finishing rollback tid 1 to smithi18337221-46 2024-09-17T16:42:25.487 INFO:tasks.rados.rados.0.smithi183.stdout:123: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:25.487 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.492 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.492 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:25.492 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:25.496 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:25.500 INFO:tasks.rados.rados.0.smithi183.stdout:124: finishing rollback tid 2 to smithi18337221-46 2024-09-17T16:42:25.500 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 46 v 16 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-09-17T16:42:25.501 INFO:tasks.rados.rados.0.smithi183.stdout:120: done (3 left) 2024-09-17T16:42:25.501 INFO:tasks.rados.rados.0.smithi183.stdout:121: done (2 left) 2024-09-17T16:42:25.501 INFO:tasks.rados.rados.0.smithi183.stdout:123: done (1 left) 2024-09-17T16:42:25.501 INFO:tasks.rados.rados.0.smithi183.stdout:124: done (0 left) 2024-09-17T16:42:25.501 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 36 current snap is 10 2024-09-17T16:42:25.501 INFO:tasks.rados.rados.0.smithi183.stdout:125: seq_num 67 ranges {589824=753664,1343488=376832} 2024-09-17T16:42:25.502 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:25.505 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:25.503+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:25.507 INFO:tasks.rados.rados.0.smithi183.stdout:125: writing smithi18337221-36 from 589824 to 1343488 tid 1 2024-09-17T16:42:25.509 INFO:tasks.rados.rados.0.smithi183.stdout:125: writing smithi18337221-36 from 1343488 to 1720320 tid 2 2024-09-17T16:42:25.509 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 33 current snap is 10 2024-09-17T16:42:25.510 INFO:tasks.rados.rados.0.smithi183.stdout:126: seq_num 68 ranges {540672=770048,1310720=376832} 2024-09-17T16:42:25.517 INFO:tasks.rados.rados.0.smithi183.stdout:126: writing smithi18337221-33 from 540672 to 1310720 tid 1 2024-09-17T16:42:25.519 INFO:tasks.rados.rados.0.smithi183.stdout:126: writing smithi18337221-33 from 1310720 to 1687552 tid 2 2024-09-17T16:42:25.519 INFO:tasks.rados.rados.0.smithi183.stdout:127: snap_remove snap 4 2024-09-17T16:42:25.570 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:25.568+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:25.609 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:25.609 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:25.618 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:25.671 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:25.669+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:25.725 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:25.725 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:25.731 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:25.771 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:25.770+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:25.872 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:25.870+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:25.875 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:25.875 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:25.884 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:25.973 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:25.971+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:26.027 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.027 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.035 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:26.074 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:26.072+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:26.141 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.141 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.147 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:26.191 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:26.189+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:26.251 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.251 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.260 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:26.276 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:26.274+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:26.377 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:26.375+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:26.403 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.403 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.412 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:26.458 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:42:26.463 INFO:tasks.rados.rados.0.smithi183.stdout:127: done (2 left) 2024-09-17T16:42:26.463 INFO:tasks.rados.rados.0.smithi183.stdout:128: delete oid 19 current snap is 10 2024-09-17T16:42:26.463 INFO:tasks.rados.rados.0.smithi183.stdout:125: finishing write tid 1 to smithi18337221-36 2024-09-17T16:42:26.463 INFO:tasks.rados.rados.0.smithi183.stdout:125: finishing write tid 2 to smithi18337221-36 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:125: finishing write tid 3 to smithi18337221-36 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:125: finishing write tid 4 to smithi18337221-36 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:125: oid 36 updating version 0 to 19 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:125: oid 36 version 19 is already newer than 17 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:125: oid 36 version 19 is already newer than 18 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 36 v 19 (ObjNum 67 snap 10 seq_num 67) dirty exists 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:125: left oid 36 (ObjNum 67 snap 10 seq_num 67) 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:126: finishing write tid 1 to smithi18337221-33 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:126: finishing write tid 2 to smithi18337221-33 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:126: finishing write tid 3 to smithi18337221-33 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:126: finishing write tid 4 to smithi18337221-33 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:126: oid 33 updating version 0 to 47 2024-09-17T16:42:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:126: oid 33 version 47 is already newer than 46 2024-09-17T16:42:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:126: oid 33 updating version 47 to 48 2024-09-17T16:42:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 48 (ObjNum 68 snap 10 seq_num 68) dirty exists 2024-09-17T16:42:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:126: left oid 33 (ObjNum 68 snap 10 seq_num 68) 2024-09-17T16:42:26.475 INFO:tasks.rados.rados.0.smithi183.stdout:125: done (2 left) 2024-09-17T16:42:26.475 INFO:tasks.rados.rados.0.smithi183.stdout:126: done (1 left) 2024-09-17T16:42:26.475 INFO:tasks.rados.rados.0.smithi183.stdout:128: done (0 left) 2024-09-17T16:42:26.475 INFO:tasks.rados.rados.0.smithi183.stdout:129: delete oid 14 current snap is 10 2024-09-17T16:42:26.477 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:26.476+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:26.491 INFO:tasks.rados.rados.0.smithi183.stdout:129: done (0 left) 2024-09-17T16:42:26.491 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 37 current snap is 10 2024-09-17T16:42:26.491 INFO:tasks.rados.rados.0.smithi183.stdout:130: seq_num 71 ranges {606208=425984,1032192=573440,1605632=196608} 2024-09-17T16:42:26.496 INFO:tasks.rados.rados.0.smithi183.stdout:130: writing smithi18337221-37 from 606208 to 1032192 tid 1 2024-09-17T16:42:26.499 INFO:tasks.rados.rados.0.smithi183.stdout:130: writing smithi18337221-37 from 1032192 to 1605632 tid 2 2024-09-17T16:42:26.501 INFO:tasks.rados.rados.0.smithi183.stdout:130: writing smithi18337221-37 from 1605632 to 1802240 tid 3 2024-09-17T16:42:26.501 INFO:tasks.rados.rados.0.smithi183.stdout:131: rollback oid 15 current snap is 10 2024-09-17T16:42:26.501 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 15 to 7 2024-09-17T16:42:26.501 INFO:tasks.rados.rados.0.smithi183.stdout:132: read oid 46 snap -1 2024-09-17T16:42:26.501 INFO:tasks.rados.rados.0.smithi183.stdout:132: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-17T16:42:26.501 INFO:tasks.rados.rados.0.smithi183.stdout:133: read oid 18 snap -1 2024-09-17T16:42:26.502 INFO:tasks.rados.rados.0.smithi183.stdout:133: expect deleted 2024-09-17T16:42:26.502 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 25 current snap is 10 2024-09-17T16:42:26.502 INFO:tasks.rados.rados.0.smithi183.stdout:134: seq_num 72 ranges {1261568=442368,1703936=720896,2424832=49152} 2024-09-17T16:42:26.511 INFO:tasks.rados.rados.0.smithi183.stdout:134: writing smithi18337221-25 from 1261568 to 1703936 tid 1 2024-09-17T16:42:26.515 INFO:tasks.rados.rados.0.smithi183.stdout:134: writing smithi18337221-25 from 1703936 to 2424832 tid 2 2024-09-17T16:42:26.516 INFO:tasks.rados.rados.0.smithi183.stdout:134: writing smithi18337221-25 from 2424832 to 2473984 tid 3 2024-09-17T16:42:26.516 INFO:tasks.rados.rados.0.smithi183.stdout:135: delete oid 47 current snap is 10 2024-09-17T16:42:26.516 INFO:tasks.rados.rados.0.smithi183.stdout:132: expect (ObjNum 45 snap 0 seq_num 45) 2024-09-17T16:42:26.520 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 762961 2024-09-17T16:42:26.521 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 77735 2024-09-17T16:42:26.526 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.527 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.528 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:26.536 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:130: finishing write tid 1 to smithi18337221-37 2024-09-17T16:42:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:130: finishing write tid 2 to smithi18337221-37 2024-09-17T16:42:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:130: finishing write tid 3 to smithi18337221-37 2024-09-17T16:42:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:130: finishing write tid 4 to smithi18337221-37 2024-09-17T16:42:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:131: finishing rollback tid 0 to smithi18337221-15 2024-09-17T16:42:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:130: finishing write tid 5 to smithi18337221-37 2024-09-17T16:42:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:130: oid 37 updating version 0 to 15 2024-09-17T16:42:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:130: oid 37 updating version 15 to 16 2024-09-17T16:42:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:130: oid 37 updating version 16 to 17 2024-09-17T16:42:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:130: oid 37 version 17 is already newer than 14 2024-09-17T16:42:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 17 (ObjNum 71 snap 10 seq_num 71) dirty exists 2024-09-17T16:42:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:130: left oid 37 (ObjNum 71 snap 10 seq_num 71) 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:131: finishing rollback tid 1 to smithi18337221-15 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:130: done (5 left) 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:132: done (4 left) 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:133: done (3 left) 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:135: done (2 left) 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:136: snap_create 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:131: finishing rollback tid 2 to smithi18337221-15 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 21 (ObjNum 57 snap 3 seq_num 57) dirty exists 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:134: finishing write tid 1 to smithi18337221-25 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:134: finishing write tid 2 to smithi18337221-25 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:134: finishing write tid 3 to smithi18337221-25 2024-09-17T16:42:26.540 INFO:tasks.rados.rados.0.smithi183.stdout:134: finishing write tid 4 to smithi18337221-25 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:134: finishing write tid 5 to smithi18337221-25 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:134: oid 25 updating version 0 to 20 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:134: oid 25 version 20 is already newer than 19 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:134: oid 25 version 20 is already newer than 17 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:134: oid 25 version 20 is already newer than 18 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 25 v 20 (ObjNum 72 snap 10 seq_num 72) dirty exists 2024-09-17T16:42:26.541 INFO:tasks.rados.rados.0.smithi183.stdout:134: left oid 25 (ObjNum 72 snap 10 seq_num 72) 2024-09-17T16:42:26.579 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:26.577+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:26.680 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.680 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.680 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:26.678+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:26.688 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:26.781 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:26.779+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:26.789 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.790 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.798 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:26.882 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:26.880+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:26.902 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:26.902 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:26.911 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:26.983 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:26.981+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:27.025 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.025 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.034 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:27.084 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:27.082+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:27.137 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.137 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:27.185 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:27.183+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:27.249 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.249 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.258 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:27.285 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:27.283+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:27.360 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.360 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.368 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:27.386 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:27.384+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:27.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:27.471 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.471 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.479 INFO:tasks.rados.rados.0.smithi183.stdout:131: done (2 left) 2024-09-17T16:42:27.479 INFO:tasks.rados.rados.0.smithi183.stdout:134: done (1 left) 2024-09-17T16:42:27.479 INFO:tasks.rados.rados.0.smithi183.stdout:136: done (0 left) 2024-09-17T16:42:27.479 INFO:tasks.rados.rados.0.smithi183.stdout:137: snap_remove snap 5 2024-09-17T16:42:27.480 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:27.487 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:27.485+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:27.569 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:27.583 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.583 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.587 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:27.587 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:27.588 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:27.586+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:27.593 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:27.605 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:27.605 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:27.623 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:27.624 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:27.639 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:27.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:27.657 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:27.673 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:27.673 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:27.689 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:27.687+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:27.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:27.691 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:27.696 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:27.696 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:27.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:27.707 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:27.707 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:27.724 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:27.725 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:27.741 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:27.742 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:27.759 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:27.759 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:27.774 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:27.775 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:27.790 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:27.787+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:27.792 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:27.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:27.790+0000 7fdafe7fc640 0 -- 172.21.15.60:0/498217066 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fdb0021a010 msgr2=0x7fdb0021c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:27.807 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:27.807 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:27.807 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:27.807 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:27.807 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:27.816 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:27.900 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:27.898+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:27.960 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.483223+0000", 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.474391337, 2024-09-17T16:42:27.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049082409999999998, 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483223+0000", 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483223+0000", 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483224+0000", 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.61e-07 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483241+0000", 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7206000000000001e-05 2024-09-17T16:42:27.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483253+0000", 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1800000000000001e-05 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483264+0000", 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1599e-05 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483557+0000", 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000292596 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.483566+0000", 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1209999999999996e-06 2024-09-17T16:42:27.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488086+0000", 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045198649999999996 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488131+0000", 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5293000000000002e-05 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:27.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.464958037000001, 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067612239999999997, 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492657+0000", 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.066e-06 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493093+0000", 2024-09-17T16:42:27.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043573899999999998 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493113+0000", 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9661999999999999e-05 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493126+0000", 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2778e-05 2024-09-17T16:42:27.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493222+0000", 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6797000000000002e-05 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493232+0000", 2024-09-17T16:42:27.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0042e-05 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499374+0000", 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061420320000000004 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499418+0000", 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3108000000000001e-05 2024-09-17T16:42:27.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.457276322, 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005312804, 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:27.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:27.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500338+0000", 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2099999999999998e-07 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500563+0000", 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022494799999999999 2024-09-17T16:42:27.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0983e-05 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500583+0000", 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4360000000000002e-06 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500651+0000", 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8580999999999999e-05 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.500663+0000", 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.152e-05 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:27.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505621+0000", 2024-09-17T16:42:27.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049577199999999997 2024-09-17T16:42:27.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:27.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505651+0000", 2024-09-17T16:42:27.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0295e-05 2024-09-17T16:42:27.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.980 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:27.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.980 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:27.980 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:27.981 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.446905889, 2024-09-17T16:42:27.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005690596, 2024-09-17T16:42:27.981 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:27.981 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:27.981 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:27.981 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:27.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:27.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:27.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:27.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:27.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:27.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.510709+0000", 2024-09-17T16:42:27.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5300000000000002e-07 2024-09-17T16:42:27.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:27.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511000+0000", 2024-09-17T16:42:27.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029004500000000001 2024-09-17T16:42:27.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:27.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511009+0000", 2024-09-17T16:42:27.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1989999999999995e-06 2024-09-17T16:42:27.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:27.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511015+0000", 2024-09-17T16:42:27.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5599999999999999e-06 2024-09-17T16:42:27.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:27.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511096+0000", 2024-09-17T16:42:27.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0453999999999999e-05 2024-09-17T16:42:27.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:27.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.511105+0000", 2024-09-17T16:42:27.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:42:27.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:27.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516357+0000", 2024-09-17T16:42:27.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052516070000000001 2024-09-17T16:42:27.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.516399+0000", 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2267e-05 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.994 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.508325+0000", 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.4492894770000007, 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056730979999999997, 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508325+0000", 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508325+0000", 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508325+0000", 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508523+0000", 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019776599999999999 2024-09-17T16:42:27.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508537+0000", 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3923999999999999e-05 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508546+0000", 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8170000000000005e-06 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:27.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508660+0000", 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114114 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.508673+0000", 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3298e-05 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513957+0000", 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052836549999999999 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513998+0000", 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0973999999999998e-05 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4460111789999992, 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013863510000000001, 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:27.999 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513354+0000", 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001750883 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513367+0000", 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3108999999999999e-05 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513376+0000", 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8969999999999997e-06 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513451+0000", 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513461+0000", 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0023999999999999e-05 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525431+0000", 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011969377 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525467+0000", 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5988000000000002e-05 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 46/34 ECSubWrite(tid=35, reqid=client.4553.0:267, at_version=46'11, trim_to=0'0, roll_forward_to=45'9))", 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511902+0000", 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4457121960000006, 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004330637, 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.004 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511902+0000", 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511902+0000", 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511903+0000", 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0299999999999999e-07 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511941+0000", 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8235000000000002e-05 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511955+0000", 2024-09-17T16:42:28.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4534e-05 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512010+0000", 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4932999999999997e-05 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512137+0000", 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000126561 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512149+0000", 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2038999999999999e-05 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.516191+0000", 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040417420000000001 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.516233+0000", 2024-09-17T16:42:28.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2089999999999999e-05 2024-09-17T16:42:28.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.009 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 46/34 ECSubWrite(tid=36, reqid=client.4553.0:268, at_version=46'12, trim_to=0'0, roll_forward_to=45'9))", 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.513148+0000", 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4444667080000002, 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040985919999999999, 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513148+0000", 2024-09-17T16:42:28.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513148+0000", 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513149+0000", 2024-09-17T16:42:28.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.091e-06 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513171+0000", 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2619000000000001e-05 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513186+0000", 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.448e-05 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513195+0000", 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0909999999999999e-06 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513370+0000", 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0001751 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513380+0000", 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9350000000000006e-06 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517199+0000", 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038186700000000001 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517246+0000", 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7605999999999998e-05 2024-09-17T16:42:28.014 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 46/34 ECSubWrite(tid=60, reqid=client.4553.0:263, at_version=46'30, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.513539+0000", 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4440754120000001, 2024-09-17T16:42:28.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038159439999999999, 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513539+0000", 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513539+0000", 2024-09-17T16:42:28.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513539+0000", 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4999999999999998e-07 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513563+0000", 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3339000000000001e-05 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513580+0000", 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6759999999999999e-05 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513589+0000", 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2499999999999995e-06 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513685+0000", 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6436999999999998e-05 2024-09-17T16:42:28.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513694+0000", 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9679999999999995e-06 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517318+0000", 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003623944 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517355+0000", 2024-09-17T16:42:28.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6795999999999998e-05 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 46/34 ECSubWrite(tid=37, reqid=client.4553.0:269, at_version=46'13, trim_to=0'0, roll_forward_to=45'9))", 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.514215+0000", 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4433996199999992, 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057475490000000002, 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.020 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514215+0000", 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514215+0000", 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514216+0000", 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9899999999999999e-07 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514236+0000", 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0256000000000001e-05 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514248+0000", 2024-09-17T16:42:28.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2044e-05 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514257+0000", 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.687e-06 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.516333+0000", 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020760840000000002 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.516343+0000", 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0328e-05 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519925+0000", 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035817729999999999 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519962+0000", 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7478000000000003e-05 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 46/34 ECSubWrite(tid=61, reqid=client.4553.0:264, at_version=46'31, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:42:28.025 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.514998+0000", 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4426160859999992, 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0049269320000000002, 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514998+0000", 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514998+0000", 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514999+0000", 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1999999999999998e-07 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515022+0000", 2024-09-17T16:42:28.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2779999999999999e-05 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515037+0000", 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4946000000000001e-05 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515047+0000", 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8889999999999997e-06 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515318+0000", 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027155300000000001 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515329+0000", 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0866000000000001e-05 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519885+0000", 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045558359999999997 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519925+0000", 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0142000000000003e-05 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 46/34 ECSubWrite(tid=62, reqid=client.4553.0:265, at_version=46'32, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.515895+0000", 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4417198839999994, 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040596340000000003, 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515895+0000", 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515895+0000", 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515895+0000", 2024-09-17T16:42:28.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0999999999999997e-07 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515914+0000", 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8666000000000001e-05 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515926+0000", 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2393e-05 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515946+0000", 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9021999999999998e-05 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.516281+0000", 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033579500000000001 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.516290+0000", 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2700000000000004e-06 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519930+0000", 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0036404710000000002 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519954+0000", 2024-09-17T16:42:28.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4107000000000001e-05 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4376632960000002, 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083605350000000005, 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.036 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9800000000000002e-07 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520423+0000", 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047090499999999998 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520443+0000", 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0477000000000001e-05 2024-09-17T16:42:28.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520453+0000", 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520913+0000", 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045979899999999999 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520921+0000", 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3010000000000007e-06 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528270+0000", 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073484370000000002 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2073999999999997e-05 2024-09-17T16:42:28.040 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4349445280000008, 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089774009999999994, 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.041 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:28.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999999e-07 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523392+0000", 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072203800000000004 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523434+0000", 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1365000000000001e-05 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523451+0000", 2024-09-17T16:42:28.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7119e-05 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523565+0000", 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011433 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523577+0000", 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1697e-05 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531599+0000", 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080225629999999999 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531647+0000", 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7960000000000002e-05 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.045 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=34, reqid=client.4553.0:261, at_version=46'10, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.523093+0000", 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4345210099999992, 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058157440000000003, 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523093+0000", 2024-09-17T16:42:28.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523093+0000", 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523094+0000", 2024-09-17T16:42:28.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.78e-07 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000139744 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523247+0000", 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2982999999999999e-05 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523257+0000", 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5670000000000001e-06 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525531+0000", 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022741910000000001 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525541+0000", 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0219e-05 2024-09-17T16:42:28.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528861+0000", 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033199219999999999 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528909+0000", 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8239999999999999e-05 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.050 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 46/34 ECSubWrite(tid=20, reqid=client.4553.0:271, at_version=46'13, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.528138+0000", 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4294761089999994, 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065427530000000001, 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528138+0000", 2024-09-17T16:42:28.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528138+0000", 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528139+0000", 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0500000000000002e-07 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528415+0000", 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00027570699999999998 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528429+0000", 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4489e-05 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528438+0000", 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0750000000000004e-06 2024-09-17T16:42:28.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528503+0000", 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4270000000000006e-05 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528512+0000", 2024-09-17T16:42:28.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3740000000000004e-06 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.534645+0000", 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006132813 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.534681+0000", 2024-09-17T16:42:28.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.612e-05 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 46/34 ECSubWrite(tid=21, reqid=client.4553.0:272, at_version=46'14, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.530923+0000", 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.4266918660000005, 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037756109999999999, 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.530923+0000", 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.530923+0000", 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.530923+0000", 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9999999999999996e-07 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.530942+0000", 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8896e-05 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.530957+0000", 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4401e-05 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.530965+0000", 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5220000000000007e-06 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531692+0000", 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072647100000000002 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531699+0000", 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3529999999999997e-06 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.534685+0000", 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0029857690000000001 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.534698+0000", 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3399e-05 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4724592989999996, 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080533949999999997, 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:28.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8700000000000002e-07 2024-09-17T16:42:28.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485843+0000", 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068809999999999997 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485856+0000", 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2561000000000001e-05 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485863+0000", 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485940+0000", 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6754000000000004e-05 2024-09-17T16:42:28.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485952+0000", 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2438e-05 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.493183+0000", 2024-09-17T16:42:28.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072314069999999996 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.493208+0000", 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5083e-05 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 50/34 ECSubWrite(tid=28, reqid=client.4553.0:298, at_version=50'17, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.490486+0000", 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.467128883, 2024-09-17T16:42:28.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054574460000000003, 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490486+0000", 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490486+0000", 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490486+0000", 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3399999999999998e-07 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490739+0000", 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025249300000000001 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490752+0000", 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3185e-05 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490758+0000", 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.964e-06 2024-09-17T16:42:28.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490816+0000", 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7716000000000001e-05 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.490828+0000", 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1929e-05 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.495918+0000", 2024-09-17T16:42:28.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.005090804 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.495943+0000", 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4521000000000001e-05 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 50/34 ECSubWrite(tid=29, reqid=client.4553.0:299, at_version=50'18, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.492848+0000", 2024-09-17T16:42:28.071 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.4647664660000004, 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034037939999999999, 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.492848+0000", 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.492848+0000", 2024-09-17T16:42:28.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.492849+0000", 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3900000000000003e-07 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.492868+0000", 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9490000000000001e-05 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.492888+0000", 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9446999999999999e-05 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.492897+0000", 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1300000000000007e-06 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.493040+0000", 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014338600000000001 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.493050+0000", 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4660000000000005e-06 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.496232+0000", 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031825949999999999 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.496252+0000", 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9341e-05 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.075 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.076 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.076 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:28.077 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:28.077 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:28.078 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:28.079 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:28.080 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:28.080 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:28.075+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:28.178 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:28.176+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:28.222 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:28.222 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:28.222 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:28.230 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:28.279 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:28.277+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:28.331 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:28.331 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:28.332 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:28.332 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:28.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:28.379 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:28.378+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:28.443 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:28.443 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:28.443 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:194 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477712+0000", 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.962915572, 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010934931, 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.444 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 194 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477712+0000", 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477712+0000", 2024-09-17T16:42:28.445 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477714+0000", 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.978e-06 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477723+0000", 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477740+0000", 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7058000000000002e-05 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477752+0000", 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1354e-05 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477853+0000", 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000101547 2024-09-17T16:42:28.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9889999999999998e-06 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480225+0000", 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023626950000000002 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.448 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480299+0000", 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4194000000000001e-05 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488647+0000", 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083482360000000002 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.449 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:195 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.962851169, 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01148677, 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 195 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.450 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-09-17T16:42:28.451 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477782+0000", 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0939999999999998e-06 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477789+0000", 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.452 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477795+0000", 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5849999999999999e-06 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000159579 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477958+0000", 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9879999999999998e-06 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.453 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480631+0000", 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026728429999999998 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480694+0000", 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2594000000000004e-05 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.489263+0000", 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085697580000000002 2024-09-17T16:42:28.454 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:196 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.962793316999999, 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011896488, 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.455 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 196 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:28.456 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477838+0000", 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9239999999999999e-06 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.457 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477844+0000", 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.891e-06 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477850+0000", 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4189999999999999e-06 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000145926 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.458 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.478002+0000", 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2090000000000002e-06 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480989+0000", 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002986542 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481054+0000", 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5227000000000004e-05 2024-09-17T16:42:28.459 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.489731+0000", 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086769480000000003 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s4 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.950096268999999, 2024-09-17T16:42:28.460 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013315062000000001, 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:28.461 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490758+0000", 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022558800000000001 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.462 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490774+0000", 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6350000000000001e-05 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490784+0000", 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5750000000000007e-06 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490854+0000", 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0339000000000005e-05 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.463 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490864+0000", 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6660000000000003e-06 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503808+0000", 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012944073 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.464 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503847+0000", 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8612999999999998e-05 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:217 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.496408+0000", 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.944219657, 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090979679999999997, 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.465 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 217 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496408+0000", 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.466 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496408+0000", 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496410+0000", 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6920000000000001e-06 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496417+0000", 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2110000000000001e-06 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.467 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496429+0000", 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2143999999999999e-05 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496439+0000", 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.01e-05 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496503+0000", 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3202999999999998e-05 2024-09-17T16:42:28.468 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496602+0000", 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9907000000000004e-05 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497400+0000", 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079713500000000003 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.469 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503869+0000", 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064689650000000001 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505414+0000", 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001545638 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.505506+0000", 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1972999999999995e-05 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.470 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:218 3.0s0 3:0cb75d13:::smithi18337221-6:head [rollback 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.944164075, 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011138148, 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.471 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.472 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-09-17T16:42:28.472 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.472 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.472 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.472 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.472 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9500000000000002e-07 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.473 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496468+0000", 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3589999999999999e-06 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496475+0000", 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4220000000000003e-06 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496484+0000", 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8920000000000006e-06 2024-09-17T16:42:28.474 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497856+0000", 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013717 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497951+0000", 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5154000000000004e-05 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.475 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498460+0000", 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000509433 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503871+0000", 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054104929999999997 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507525+0000", 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003654629 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.476 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507602+0000", 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6470999999999993e-05 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:219 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.944134882, 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011259471, 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.477 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.478 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7500000000000001e-07 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496496+0000", 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.745e-06 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496502+0000", 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.964e-06 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496507+0000", 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8300000000000003e-06 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499175+0000", 2024-09-17T16:42:28.480 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026681489999999999 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499273+0000", 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8039000000000001e-05 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499803+0000", 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00053041999999999998 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.481 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503913+0000", 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041092480000000002 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507695+0000", 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003782498 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507752+0000", 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.482 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:251 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~622592] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9355254110000004, 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013520938, 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.483 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 251 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.484 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505104+0000", 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8870000000000001e-06 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506163+0000", 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010585 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506177+0000", 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4022999999999999e-05 2024-09-17T16:42:28.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506185+0000", 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7209999999999994e-06 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506254+0000", 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9264000000000006e-05 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506349+0000", 2024-09-17T16:42:28.486 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4704999999999995e-05 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507791+0000", 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014424469999999999 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517101+0000", 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093103430000000004 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.487 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518539+0000", 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00143816 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518623+0000", 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3887999999999994e-05 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:252 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~376832] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:28.488 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9334726579999995, 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014876686, 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 252 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.489 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507156+0000", 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2309999999999999e-06 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.490 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507825+0000", 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066852899999999995 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507839+0000", 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4260999999999999e-05 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507848+0000", 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9660000000000002e-06 2024-09-17T16:42:28.491 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513602+0000", 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057539069999999999 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513711+0000", 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010927199999999999 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.492 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.514507+0000", 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079574400000000003 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518107+0000", 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035998129999999999 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.521980+0000", 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038731780000000001 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.493 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522032+0000", 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1785e-05 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:253 3.9s0 3:97a3b59a:::smithi18337221-19:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9327559910000005, 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01439824, 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.494 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 253 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507873+0000", 2024-09-17T16:42:28.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1319999999999999e-06 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507897+0000", 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.44e-05 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507905+0000", 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9980000000000003e-06 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507913+0000", 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2849999999999997e-06 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517178+0000", 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092654350000000007 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517280+0000", 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102011 2024-09-17T16:42:28.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517762+0000", 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048150100000000001 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518681+0000", 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091987099999999995 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522146+0000", 2024-09-17T16:42:28.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003464895 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522270+0000", 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123712 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:254 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:42:28.500 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9327033470000003, 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014640482, 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 254 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:42:28.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507925+0000", 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4700000000000001e-07 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507927+0000", 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0789999999999999e-06 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507932+0000", 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8400000000000002e-06 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507935+0000", 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3380000000000001e-06 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518013+0000", 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077697 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518096+0000", 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2707000000000006e-05 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522552+0000", 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044558430000000001 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522565+0000", 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3431000000000001e-05 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.505 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:268 3.9s0 3:9a71e4fb:::smithi18337221-36:head [rollback 6] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.510896+0000", 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.9297317839999995, 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067185709999999996, 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 268 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510896+0000", 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510896+0000", 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510897+0000", 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3629999999999999e-06 2024-09-17T16:42:28.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510903+0000", 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9730000000000002e-06 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510926+0000", 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2863000000000001e-05 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510956+0000", 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9604999999999999e-05 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512385+0000", 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014286920000000001 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512484+0000", 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9271999999999994e-05 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513110+0000", 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062574500000000003 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514340+0000", 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012305720000000001 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517551+0000", 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003210835 2024-09-17T16:42:28.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517615+0000", 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3651000000000004e-05 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:269 3.9s0 3:9a71e4fb:::smithi18337221-36:head [append 0~0] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.510966+0000", 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.9296614949999995, 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093160120000000003, 2024-09-17T16:42:28.511 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 269 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510966+0000", 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510966+0000", 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510967+0000", 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8500000000000001e-07 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510969+0000", 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3910000000000001e-06 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510983+0000", 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3993e-05 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.510989+0000", 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6250000000000004e-06 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513518+0000", 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0025295280000000001 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513608+0000", 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9319000000000003e-05 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.514081+0000", 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047321 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.515625+0000", 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001544017 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520180+0000", 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045548560000000004 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520282+0000", 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102488 2024-09-17T16:42:28.516 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as4 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 8.9289332009999995, 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011705553, 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3700000000000001e-07 2024-09-17T16:42:28.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512098+0000", 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040260399999999998 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4521999999999999e-05 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512121+0000", 2024-09-17T16:42:28.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.969e-06 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512181+0000", 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9756000000000002e-05 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512191+0000", 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0351e-05 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523363+0000", 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011172059 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523400+0000", 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6854999999999999e-05 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:302 3.9s0 3:97a3b59a:::smithi18337221-19:8 [read 0~1310720,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:28.521 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.450847+0000", 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.989780654, 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079190409999999999, 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 302 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450847+0000", 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450847+0000", 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450849+0000", 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.17e-06 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450860+0000", 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0565e-05 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450890+0000", 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9629e-05 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450901+0000", 2024-09-17T16:42:28.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1144e-05 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450972+0000", 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0864000000000005e-05 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450977+0000", 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.524e-06 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.454780+0000", 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038033860000000002 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.454857+0000", 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6598000000000001e-05 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.458766+0000", 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039091610000000004 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.526 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:303 3.9s0 3:97a3b59a:::smithi18337221-19:8 [read 0~1310720,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.450924+0000", 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9897034150000001, 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091269990000000002, 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.527 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 303 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450924+0000", 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450924+0000", 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450925+0000", 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6899999999999998e-07 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450928+0000", 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.145e-06 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450935+0000", 2024-09-17T16:42:28.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7819999999999996e-06 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450939+0000", 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8449999999999996e-06 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451053+0000", 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114263 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451060+0000", 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4089999999999997e-06 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.455210+0000", 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041500649999999997 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.455309+0000", 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8707000000000002e-05 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.460051+0000", 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047423140000000001 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:304 3.9s0 3:97a3b59a:::smithi18337221-19:8 [read 382462~928258,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.450961+0000", 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9896666590000001, 2024-09-17T16:42:28.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097020960000000003, 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 304 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450961+0000", 2024-09-17T16:42:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450961+0000", 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450962+0000", 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5400000000000002e-07 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450964+0000", 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7499999999999999e-06 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450969+0000", 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1449999999999999e-06 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450974+0000", 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2799999999999997e-06 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451116+0000", 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014215300000000001 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451120+0000", 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4499999999999997e-06 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.457009+0000", 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0058884130000000003 2024-09-17T16:42:28.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.457085+0000", 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6129000000000002e-05 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.460663+0000", 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035784219999999999 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:305 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9896410580000001, 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010016393, 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 305 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.538 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:28.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3799999999999998e-07 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450990+0000", 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.531e-06 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450994+0000", 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3869999999999997e-06 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450998+0000", 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.907e-06 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451169+0000", 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000171282 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451178+0000", 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5590000000000006e-06 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.457382+0000", 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062037280000000004 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.457501+0000", 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119138 2024-09-17T16:42:28.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461003+0000", 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003502523 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:306 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.9896251720000002, 2024-09-17T16:42:28.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011720622999999999, 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 306 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451005+0000", 2024-09-17T16:42:28.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8729999999999999e-06 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451008+0000", 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5949999999999999e-06 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451011+0000", 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.072e-06 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451218+0000", 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020686399999999999 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451222+0000", 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.444e-06 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461055+0000", 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.009833385 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461120+0000", 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5279999999999998e-05 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.462723+0000", 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016028679999999999 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.548 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:307 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.989612487, 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012102027, 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 307 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451016+0000", 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3999999999999998e-07 2024-09-17T16:42:28.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451017+0000", 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6309999999999999e-06 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451021+0000", 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4170000000000001e-06 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451024+0000", 2024-09-17T16:42:28.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9019999999999999e-06 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451255+0000", 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023170600000000001 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451262+0000", 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4470000000000003e-06 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:28.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461381+0000", 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010119067000000001 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461453+0000", 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2119999999999994e-05 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.463117+0000", 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001664497 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:28.554 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:28.554 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:28.554 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:42:28.557 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:28.559 INFO:tasks.rados.rados.0.smithi183.stdout:137: done (0 left) 2024-09-17T16:42:28.559 INFO:tasks.rados.rados.0.smithi183.stdout:138: read oid 48 snap -1 2024-09-17T16:42:28.559 INFO:tasks.rados.rados.0.smithi183.stdout:138: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-17T16:42:28.559 INFO:tasks.rados.rados.0.smithi183.stdout:139: copy_from oid 15 from oid 1 current snap is 11 2024-09-17T16:42:28.559 INFO:tasks.rados.rados.0.smithi183.stdout:140: copy_from oid 43 from oid 17 current snap is 11 2024-09-17T16:42:28.559 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 46 current snap is 11 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:141: seq_num 74 ranges {770048=475136,1245184=622592,1867776=147456} 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:141: writing smithi18337221-46 from 770048 to 1245184 tid 1 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:141: writing smithi18337221-46 from 1245184 to 1867776 tid 2 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:141: writing smithi18337221-46 from 1867776 to 2015232 tid 3 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:142: copy_from oid 26 from oid 32 current snap is 11 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 8 current snap is 11 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:143: seq_num 75 ranges {131072=491520,622592=770048} 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:143: writing smithi18337221-8 from 131072 to 622592 tid 1 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:143: writing smithi18337221-8 from 622592 to 1392640 tid 2 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:144: read oid 50 snap 9 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:144: expect (ObjNum 54 snap 2 seq_num 54) 2024-09-17T16:42:28.560 INFO:tasks.rados.rados.0.smithi183.stdout:145: read oid 2 snap -1 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:145: expect (ObjNum 1 snap 0 seq_num 1) 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 13 current snap is 11 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:146: seq_num 76 ranges {1146880=507904,1654784=507904,2162688=262144} 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:146: writing smithi18337221-13 from 1146880 to 1654784 tid 1 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:146: writing smithi18337221-13 from 1654784 to 2162688 tid 2 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:146: writing smithi18337221-13 from 2162688 to 2424832 tid 3 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:147: rollback oid 10 current snap is 11 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 10 to 9 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:138: expect (ObjNum 47 snap 0 seq_num 47) 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 41550 2024-09-17T16:42:28.561 INFO:tasks.rados.rados.0.smithi183.stdout:140: finishing copy_from racing read to smithi18337221-43 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:139: finishing copy_from racing read to smithi18337221-15 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:139: finishing copy_from to smithi18337221-15 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 8 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:145: expect (ObjNum 1 snap 0 seq_num 1) 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 18567 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 17873 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:140: finishing copy_from to smithi18337221-43 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 4 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:141: finishing write tid 1 to smithi18337221-46 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:141: finishing write tid 2 to smithi18337221-46 2024-09-17T16:42:28.562 INFO:tasks.rados.rados.0.smithi183.stdout:144: expect (ObjNum 54 snap 2 seq_num 54) 2024-09-17T16:42:28.563 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:28.552+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:28.563 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1507463 2024-09-17T16:42:28.563 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.586 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1295654 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: finishing write tid 3 to smithi18337221-46 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: finishing write tid 4 to smithi18337221-46 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: finishing write tid 5 to smithi18337221-46 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: oid 46 updating version 0 to 33 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: oid 46 version 33 is already newer than 30 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: oid 46 version 33 is already newer than 32 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: oid 46 version 33 is already newer than 31 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 46 v 33 (ObjNum 74 snap 11 seq_num 74) dirty exists 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:141: left oid 46 (ObjNum 74 snap 11 seq_num 74) 2024-09-17T16:42:28.592 INFO:tasks.rados.rados.0.smithi183.stdout:143: finishing write tid 1 to smithi18337221-8 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:143: finishing write tid 2 to smithi18337221-8 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:143: finishing write tid 3 to smithi18337221-8 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:138: done (9 left) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:139: done (8 left) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:140: done (7 left) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:141: done (6 left) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:144: done (5 left) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:145: done (4 left) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:148: read oid 40 snap -1 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:148: expect (ObjNum 39 snap 0 seq_num 39) 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:149: rollback oid 17 current snap is 11 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 17 to 6 2024-09-17T16:42:28.593 INFO:tasks.rados.rados.0.smithi183.stdout:143: finishing write tid 4 to smithi18337221-8 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:143: oid 8 updating version 0 to 65 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:143: oid 8 version 65 is already newer than 64 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:143: oid 8 updating version 65 to 66 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 8 v 66 (ObjNum 75 snap 11 seq_num 75) dirty exists 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:143: left oid 8 (ObjNum 75 snap 11 seq_num 75) 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:142: finishing copy_from racing read to smithi18337221-26 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:142: finishing copy_from to smithi18337221-26 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 26 v 4 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:147: finishing rollback tid 0 to smithi18337221-10 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:147: finishing rollback tid 1 to smithi18337221-10 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:147: finishing rollback tid 2 to smithi18337221-10 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 10 v 47 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-09-17T16:42:28.594 INFO:tasks.rados.rados.0.smithi183.stdout:146: finishing write tid 1 to smithi18337221-13 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: finishing write tid 2 to smithi18337221-13 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: finishing write tid 3 to smithi18337221-13 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: finishing write tid 4 to smithi18337221-13 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: finishing write tid 5 to smithi18337221-13 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: oid 13 updating version 0 to 21 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: oid 13 updating version 21 to 22 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: oid 13 updating version 22 to 24 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: oid 13 version 24 is already newer than 23 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 13 v 24 (ObjNum 76 snap 11 seq_num 76) dirty exists 2024-09-17T16:42:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:146: left oid 13 (ObjNum 76 snap 11 seq_num 76) 2024-09-17T16:42:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:142: done (5 left) 2024-09-17T16:42:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:143: done (4 left) 2024-09-17T16:42:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:146: done (3 left) 2024-09-17T16:42:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:147: done (2 left) 2024-09-17T16:42:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 27 current snap is 11 2024-09-17T16:42:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:150: seq_num 77 ranges {442368=524288,966656=524288,1490944=245760} 2024-09-17T16:42:28.597 INFO:tasks.rados.rados.0.smithi183.stdout:150: writing smithi18337221-27 from 442368 to 966656 tid 1 2024-09-17T16:42:28.600 INFO:tasks.rados.rados.0.smithi183.stdout:150: writing smithi18337221-27 from 966656 to 1490944 tid 2 2024-09-17T16:42:28.605 INFO:tasks.rados.rados.0.smithi183.stdout:150: writing smithi18337221-27 from 1490944 to 1736704 tid 3 2024-09-17T16:42:28.605 INFO:tasks.rados.rados.0.smithi183.stdout:151: read oid 28 snap -1 2024-09-17T16:42:28.605 INFO:tasks.rados.rados.0.smithi183.stdout:151: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:28.605 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 16 current snap is 11 2024-09-17T16:42:28.605 INFO:tasks.rados.rados.0.smithi183.stdout:152: seq_num 78 ranges {163840=557056,720896=671744,1392640=98304} 2024-09-17T16:42:28.606 INFO:tasks.rados.rados.0.smithi183.stdout:152: writing smithi18337221-16 from 163840 to 720896 tid 1 2024-09-17T16:42:28.610 INFO:tasks.rados.rados.0.smithi183.stdout:152: writing smithi18337221-16 from 720896 to 1392640 tid 2 2024-09-17T16:42:28.611 INFO:tasks.rados.rados.0.smithi183.stdout:152: writing smithi18337221-16 from 1392640 to 1490944 tid 3 2024-09-17T16:42:28.611 INFO:tasks.rados.rados.0.smithi183.stdout:153: snap_create 2024-09-17T16:42:28.611 INFO:tasks.rados.rados.0.smithi183.stdout:149: finishing rollback tid 0 to smithi18337221-17 2024-09-17T16:42:28.611 INFO:tasks.rados.rados.0.smithi183.stdout:148: expect (ObjNum 39 snap 0 seq_num 39) 2024-09-17T16:42:28.611 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.622 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.629 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.635 INFO:tasks.rados.rados.0.smithi183.stdout:149: finishing rollback tid 1 to smithi18337221-17 2024-09-17T16:42:28.635 INFO:tasks.rados.rados.0.smithi183.stdout:149: finishing rollback tid 2 to smithi18337221-17 2024-09-17T16:42:28.635 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 17 v 26 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T16:42:28.635 INFO:tasks.rados.rados.0.smithi183.stdout:151: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:28.635 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.639 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:28.644 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 154432 2024-09-17T16:42:28.647 INFO:tasks.rados.rados.0.smithi183.stdout:150: finishing write tid 1 to smithi18337221-27 2024-09-17T16:42:28.647 INFO:tasks.rados.rados.0.smithi183.stdout:150: finishing write tid 2 to smithi18337221-27 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: finishing write tid 3 to smithi18337221-27 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: finishing write tid 4 to smithi18337221-27 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: finishing write tid 5 to smithi18337221-27 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: oid 27 updating version 0 to 15 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: oid 27 version 15 is already newer than 14 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: oid 27 updating version 15 to 16 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: oid 27 updating version 16 to 17 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 27 v 17 (ObjNum 77 snap 11 seq_num 77) dirty exists 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:150: left oid 27 (ObjNum 77 snap 11 seq_num 77) 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:152: finishing write tid 1 to smithi18337221-16 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:152: finishing write tid 2 to smithi18337221-16 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:152: finishing write tid 3 to smithi18337221-16 2024-09-17T16:42:28.648 INFO:tasks.rados.rados.0.smithi183.stdout:152: finishing write tid 4 to smithi18337221-16 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:152: finishing write tid 5 to smithi18337221-16 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:152: oid 16 updating version 0 to 28 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:152: oid 16 updating version 28 to 29 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:152: oid 16 version 29 is already newer than 27 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:152: oid 16 version 29 is already newer than 26 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 16 v 29 (ObjNum 78 snap 11 seq_num 78) dirty exists 2024-09-17T16:42:28.649 INFO:tasks.rados.rados.0.smithi183.stdout:152: left oid 16 (ObjNum 78 snap 11 seq_num 78) 2024-09-17T16:42:28.655 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:28.652+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:28.675 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:28.676 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:28.676 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:28.676 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:28.684 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:28.768 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:28.766+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:28.826 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:28.826 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:28.826 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:28.827 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:28.827 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:28.836 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:28.857 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:28.855+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:28.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:28.871+0000 7f6da359e640 0 --2- 172.21.15.60:0/1357488762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6da40cdda0 0x7f6da41f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T16:42:28.959 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:28.956+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 39/34 ECSubWrite(tid=17, reqid=client.4553.0:178, at_version=39'11, trim_to=0'0, roll_forward_to=37'9))", 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.466232+0000", 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.509909034, 2024-09-17T16:42:28.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036755149999999999, 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466232+0000", 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466232+0000", 2024-09-17T16:42:28.980 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466233+0000", 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1500000000000004e-07 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466479+0000", 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00024559000000000001 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466494+0000", 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5325e-05 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466505+0000", 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1012000000000001e-05 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:28.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466634+0000", 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012896699999999999 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466647+0000", 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2782000000000001e-05 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.469865+0000", 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032184169999999999 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.469908+0000", 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2806999999999999e-05 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 39/34 ECSubWrite(tid=18, reqid=client.4553.0:178, at_version=0'0, trim_to=0'0, roll_forward_to=39'11))", 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.470373+0000", 2024-09-17T16:42:28.984 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.505768889999999, 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041048289999999999, 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470373+0000", 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:28.985 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470373+0000", 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470374+0000", 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7700000000000003e-07 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470385+0000", 2024-09-17T16:42:28.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1907e-05 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470399+0000", 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3681e-05 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470406+0000", 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7190000000000004e-06 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470468+0000", 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2157999999999997e-05 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.470479+0000", 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1175999999999999e-05 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474438+0000", 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039588970000000003 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474477+0000", 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9413999999999999e-05 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:28.989 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.494833771, 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053197139999999997, 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:28.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5600000000000005e-07 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481341+0000", 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2285e-05 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481355+0000", 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3946e-05 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481407+0000", 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1860999999999997e-05 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481521+0000", 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114799 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481534+0000", 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2384e-05 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486594+0000", 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050600350000000001 2024-09-17T16:42:28.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486627+0000", 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3748000000000003e-05 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.4s3 40/34 ECSubRead(tid=20, to_read={3:2affd2d4:::smithi18337221-25:head=0,315392,0}, subchunks={3:2affd2d4:::smithi18337221-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482141+0000", 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.494000724999999, 2024-09-17T16:42:28.994 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0044938649999999997, 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482141+0000", 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:28.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482141+0000", 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482142+0000", 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7899999999999997e-07 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482151+0000", 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2019999999999993e-06 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482167+0000", 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.658e-05 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482178+0000", 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0721e-05 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:28.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483725+0000", 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015473430000000001 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486635+0000", 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00290924 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.4s3 40/34 ECSubRead(tid=21, to_read={3:2affd2d4:::smithi18337221-25:head=0,315392,0}, subchunks={3:2affd2d4:::smithi18337221-25:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:28.998 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482338+0000", 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.493803217, 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0046545400000000004, 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482338+0000", 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:28.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482338+0000", 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482339+0000", 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.47e-07 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482347+0000", 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1130000000000001e-06 2024-09-17T16:42:29.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482361+0000", 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3407000000000001e-05 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482371+0000", 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0054000000000001e-05 2024-09-17T16:42:29.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486841+0000", 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0044705150000000004 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486993+0000", 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015160400000000001 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.002 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.493703452, 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074612999999999997, 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:29.003 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482439+0000", 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7199999999999998e-07 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482462+0000", 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2668e-05 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482473+0000", 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482481+0000", 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6130000000000004e-06 2024-09-17T16:42:29.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486671+0000", 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041899479999999998 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486680+0000", 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8869999999999998e-06 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489834+0000", 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031540069999999999 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489899+0000", 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5050999999999998e-05 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.007 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.492993416000001, 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008086981, 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:42:29.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483149+0000", 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483164+0000", 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.523e-05 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483175+0000", 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0876999999999999e-05 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483181+0000", 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3029999999999996e-06 2024-09-17T16:42:29.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488038+0000", 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048566149999999999 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488047+0000", 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3070000000000008e-06 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491189+0000", 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031416790000000001 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491235+0000", 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6241e-05 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 40/34 ECSubWrite(tid=22, reqid=osd.8.0:22, at_version=40'13, trim_to=0'0, roll_forward_to=39'11))", 2024-09-17T16:42:29.012 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.484942+0000", 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.491199317, 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063649750000000001, 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484942+0000", 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.013 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484942+0000", 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484943+0000", 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.014 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484964+0000", 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0990999999999999e-05 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.485002+0000", 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7492e-05 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.485011+0000", 2024-09-17T16:42:29.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4469999999999995e-06 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488245+0000", 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336940000000001 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488252+0000", 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1330000000000001e-06 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.016 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491269+0000", 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030173600000000002 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491307+0000", 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7988000000000003e-05 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.017 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.483554705, 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013185944, 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492588+0000", 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7600000000000006e-07 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493009+0000", 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042131299999999998 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493025+0000", 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5605000000000001e-05 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.020 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493033+0000", 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.32e-06 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1038000000000006e-05 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.021 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493124+0000", 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4909999999999994e-06 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505727+0000", 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012603346 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505773+0000", 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5855000000000001e-05 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.022 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.477605743, 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071885259999999998, 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.023 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498537+0000", 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498559+0000", 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2444000000000001e-05 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498576+0000", 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7067000000000001e-05 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:42:29.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0920000000000004e-06 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498675+0000", 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9314999999999994e-05 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498682+0000", 2024-09-17T16:42:29.026 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8699999999999992e-06 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505669+0000", 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069863959999999998 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.027 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505724+0000", 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5414999999999997e-05 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=26, reqid=client.4553.0:219, at_version=40'9, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499776+0000", 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.476365637000001, 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059763180000000004, 2024-09-17T16:42:29.028 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499776+0000", 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499776+0000", 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499777+0000", 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.091e-06 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499799+0000", 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1861999999999998e-05 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499819+0000", 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9743000000000001e-05 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499829+0000", 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0394000000000001e-05 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499895+0000", 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5639e-05 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499904+0000", 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4900000000000006e-06 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505730+0000", 2024-09-17T16:42:29.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005825551 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505752+0000", 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2548000000000002e-05 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.033 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.510614+0000", 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.465527594999999, 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045637339999999998, 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.034 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510614+0000", 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510614+0000", 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510615+0000", 2024-09-17T16:42:29.035 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.079e-06 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511249+0000", 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00063446300000000004 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.036 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511266+0000", 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6952e-05 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511275+0000", 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8820000000000007e-06 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511339+0000", 2024-09-17T16:42:29.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4135999999999997e-05 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511354+0000", 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4116e-05 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.515137+0000", 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003783823 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.515178+0000", 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0283e-05 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 55/34 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=55'17, trim_to=0'0, roll_forward_to=53'15))", 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.49825683199999998, 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056310680000000004, 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.039 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.040 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1300000000000001e-07 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477915+0000", 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0057999999999999e-05 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477931+0000", 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5760000000000002e-05 2024-09-17T16:42:29.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477943+0000", 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2612999999999999e-05 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.478042+0000", 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8463999999999998e-05 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.478055+0000", 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3062e-05 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.483451+0000", 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053963489999999999 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.483516+0000", 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4648999999999997e-05 2024-09-17T16:42:29.043 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=93, reqid=osd.5.0:93, at_version=55'60, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.485095+0000", 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.49104606200000001, 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041603279999999996, 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485095+0000", 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485095+0000", 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485096+0000", 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0599999999999999e-07 2024-09-17T16:42:29.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485119+0000", 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3790000000000001e-05 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485130+0000", 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0348e-05 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485138+0000", 2024-09-17T16:42:29.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0989999999999999e-06 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485223+0000", 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4846999999999996e-05 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.485236+0000", 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3356000000000001e-05 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.047 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489221+0000", 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039849940000000004 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489256+0000", 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4687999999999997e-05 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.048 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 55/34 ECSubWrite(tid=33, reqid=osd.8.0:33, at_version=55'22, trim_to=0'0, roll_forward_to=53'20))", 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.486317+0000", 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.48982471300000002, 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036942939999999999, 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486317+0000", 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486317+0000", 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486318+0000", 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4499999999999995e-07 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486342+0000", 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4343999999999999e-05 2024-09-17T16:42:29.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486355+0000", 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3026e-05 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486364+0000", 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0829999999999993e-06 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486468+0000", 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000104064 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486478+0000", 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5400000000000001e-06 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489957+0000", 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0034793089999999999 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.490011+0000", 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3983000000000001e-05 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.486480+0000", 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.48966185800000001, 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003568547, 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.053 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486480+0000", 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486480+0000", 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486480+0000", 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5099999999999999e-07 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486503+0000", 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2855999999999999e-05 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486517+0000", 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.361e-05 2024-09-17T16:42:29.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486528+0000", 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1018e-05 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486632+0000", 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000104361 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486641+0000", 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1779999999999992e-06 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.490019+0000", 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003377971 2024-09-17T16:42:29.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.490048+0000", 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8901999999999999e-05 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.058 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.498768+0000", 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.47737334799999998, 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00632702, 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.498768+0000", 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.498768+0000", 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.498769+0000", 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.11e-06 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499177+0000", 2024-09-17T16:42:29.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00040757800000000002 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499189+0000", 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2265e-05 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499195+0000", 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3389999999999998e-06 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499257+0000", 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1458999999999996e-05 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499269+0000", 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1734e-05 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505064+0000", 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057956509999999998 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505095+0000", 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0883999999999998e-05 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.471339803, 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083741470000000002, 2024-09-17T16:42:29.063 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504803+0000", 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9100000000000002e-07 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505695+0000", 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089272400000000001 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505712+0000", 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6320999999999998e-05 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505720+0000", 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6780000000000006e-06 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505787+0000", 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6303000000000005e-05 2024-09-17T16:42:29.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505797+0000", 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0455000000000001e-05 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513105+0000", 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007307717 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513176+0000", 2024-09-17T16:42:29.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1057999999999996e-05 2024-09-17T16:42:29.068 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.068 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.068 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=98, reqid=osd.5.0:98, at_version=55'68, trim_to=0'0, roll_forward_to=55'62))", 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.512356+0000", 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.46378573299999998, 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032810389999999999, 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512356+0000", 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512356+0000", 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512357+0000", 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.424e-06 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512386+0000", 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.866e-05 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512398+0000", 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1929999999999999e-05 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512406+0000", 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3990000000000004e-06 2024-09-17T16:42:29.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512645+0000", 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00023884700000000001 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512654+0000", 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3309999999999993e-06 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515597+0000", 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002942592 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515637+0000", 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9855999999999999e-05 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=99, reqid=osd.5.0:99, at_version=55'70, trim_to=0'0, roll_forward_to=55'62))", 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.513260+0000", 2024-09-17T16:42:29.073 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.46288125800000002, 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031237510000000001, 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513260+0000", 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513260+0000", 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513261+0000", 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4099999999999998e-07 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513287+0000", 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5709999999999999e-05 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513303+0000", 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5820000000000001e-05 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513311+0000", 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4069999999999993e-06 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513375+0000", 2024-09-17T16:42:29.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4110999999999997e-05 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513384+0000", 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3279999999999995e-06 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.516350+0000", 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00296569 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.516384+0000", 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3943999999999999e-05 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.078 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:29.079 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:29.080 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:29.077+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:29.180 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:29.178+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:29.182 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:29.182 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:29.182 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:29.182 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:29.190 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:29.281 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:29.279+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:29.332 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:29.333 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:29.333 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:29.333 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:29.333 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:29.341 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:29.385 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:29.383+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.960521208999999, 2024-09-17T16:42:29.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079208060000000007, 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481603+0000", 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.75e-07 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482071+0000", 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046812600000000002 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482084+0000", 2024-09-17T16:42:29.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3057000000000001e-05 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482091+0000", 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3540000000000002e-06 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482223+0000", 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013139799999999999 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482253+0000", 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0824000000000002e-05 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489462+0000", 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007208356 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489523+0000", 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1216000000000005e-05 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.449 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498775+0000", 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.943348834, 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057659850000000004, 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498775+0000", 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498775+0000", 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498776+0000", 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.294e-06 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498945+0000", 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016891000000000001 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498966+0000", 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.143e-05 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498975+0000", 2024-09-17T16:42:29.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2350000000000005e-06 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499057+0000", 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1497999999999998e-05 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499069+0000", 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2118e-05 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504499+0000", 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054296769999999999 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504541+0000", 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1823000000000003e-05 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:29.455 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.94237959, 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062455490000000004, 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499751+0000", 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8290000000000002e-06 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500848+0000", 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001096889 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500866+0000", 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8899999999999999e-05 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500877+0000", 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0709e-05 2024-09-17T16:42:29.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500961+0000", 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3460000000000004e-05 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500974+0000", 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3546e-05 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505946+0000", 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049713459999999998 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505989+0000", 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3869999999999998e-05 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=73, reqid=client.4553.0:197, at_version=40'19, trim_to=0'0, roll_forward_to=40'17))", 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.512914+0000", 2024-09-17T16:42:29.461 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.929209312999999, 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0021550419999999998, 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512914+0000", 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512914+0000", 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.512915+0000", 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513034+0000", 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011887699999999999 2024-09-17T16:42:29.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513046+0000", 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1975e-05 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513054+0000", 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9240000000000007e-06 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513116+0000", 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1808000000000002e-05 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.513122+0000", 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4219999999999997e-06 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.515037+0000", 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019149239999999999 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.515069+0000", 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2254e-05 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 41/34 ECSubWrite(tid=16, reqid=client.4553.0:221, at_version=41'10, trim_to=0'0, roll_forward_to=40'8))", 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.960558877, 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0029992180000000001, 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.466 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481565+0000", 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.55e-07 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481702+0000", 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000137713 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481718+0000", 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5668e-05 2024-09-17T16:42:29.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481731+0000", 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2537999999999999e-05 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481828+0000", 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7083000000000005e-05 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.481842+0000", 2024-09-17T16:42:29.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789e-05 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.484527+0000", 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026840290000000001 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:14.484564+0000", 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7243000000000002e-05 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.470 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.9305070050000008, 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066825230000000001, 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:29.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511617+0000", 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512095+0000", 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00047857800000000001 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6481999999999999e-05 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512122+0000", 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0195e-05 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512212+0000", 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9619999999999999e-05 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512224+0000", 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1997999999999999e-05 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518268+0000", 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060445969999999996 2024-09-17T16:42:29.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518299+0000", 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0811e-05 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.9221712560000004, 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003840053, 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.475 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.519953+0000", 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9599999999999998e-07 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520159+0000", 2024-09-17T16:42:29.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020548800000000001 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520171+0000", 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2687999999999999e-05 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520178+0000", 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2899999999999999e-06 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520225+0000", 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7772999999999998e-05 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520232+0000", 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9809999999999997e-06 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523752+0000", 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035199960000000001 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523792+0000", 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9941000000000003e-05 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.473648+0000", 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.9684751729999999, 2024-09-17T16:42:29.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0058558050000000004, 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.473648+0000", 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.473648+0000", 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.473649+0000", 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2500000000000005e-07 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474314+0000", 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066515200000000002 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474325+0000", 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0730000000000001e-05 2024-09-17T16:42:29.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474330+0000", 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5770000000000001e-06 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474384+0000", 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.321e-05 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474390+0000", 2024-09-17T16:42:29.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8190000000000003e-06 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.479472+0000", 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050817060000000001 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.479504+0000", 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1885999999999999e-05 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 55/34 ECSubWrite(tid=121, reqid=osd.4.0:121, at_version=55'39, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.486469+0000", 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.95565486499999996, 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027884350000000001, 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486469+0000", 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486469+0000", 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486469+0000", 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2399999999999997e-07 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486494+0000", 2024-09-17T16:42:29.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4241999999999999e-05 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486508+0000", 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4282e-05 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.486571+0000", 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2743999999999994e-05 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.487 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487091+0000", 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00052077199999999997 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487102+0000", 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0360000000000001e-05 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489217+0000", 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002115652 2024-09-17T16:42:29.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489257+0000", 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9558999999999999e-05 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 55/34 ECSubWrite(tid=122, reqid=osd.4.0:119, at_version=0'0, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.487234+0000", 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.95488951700000002, 2024-09-17T16:42:29.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00203718, 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487234+0000", 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487234+0000", 2024-09-17T16:42:29.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487234+0000", 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487252+0000", 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.736e-05 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487264+0000", 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2515e-05 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487274+0000", 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4429999999999992e-06 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487366+0000", 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2318000000000006e-05 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487376+0000", 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0412e-05 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489216+0000", 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0018393839999999999 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489271+0000", 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5220000000000003e-05 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 55/34 ECSubWrite(tid=123, reqid=osd.4.0:123, at_version=55'41, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.487617+0000", 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.95450663499999999, 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002149415, 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.494 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487617+0000", 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487617+0000", 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487618+0000", 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3200000000000004e-07 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487641+0000", 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3354999999999999e-05 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487657+0000", 2024-09-17T16:42:29.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5568000000000001e-05 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487665+0000", 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.884e-06 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487887+0000", 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00022116 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.487897+0000", 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0301e-05 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489729+0000", 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0018320439999999999 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489766+0000", 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7271000000000003e-05 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.498 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.94883071600000002, 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007546713, 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:42:29.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493294+0000", 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.623e-06 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493665+0000", 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037080199999999999 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493684+0000", 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8737999999999999e-05 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493694+0000", 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9429999999999995e-06 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493819+0000", 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012501100000000001 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0801999999999999e-05 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.500799+0000", 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00696892 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.500839+0000", 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0874000000000002e-05 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.503 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.514687+0000", 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.92743630300000002, 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062206309999999999, 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.514687+0000", 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.504 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.514687+0000", 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.514687+0000", 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1899999999999998e-07 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515187+0000", 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00049913599999999996 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515203+0000", 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6705e-05 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515211+0000", 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3170000000000004e-06 2024-09-17T16:42:29.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515284+0000", 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3623999999999998e-05 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515311+0000", 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6333e-05 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.507 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.520875+0000", 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005564004 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.520908+0000", 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3192999999999999e-05 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.508 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.521701+0000", 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.920421975, 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045696060000000004, 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521701+0000", 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521701+0000", 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521702+0000", 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0800000000000004e-07 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521887+0000", 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018524200000000001 2024-09-17T16:42:29.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521902+0000", 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4385e-05 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521910+0000", 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.388e-06 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521970+0000", 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0061e-05 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521980+0000", 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7399999999999999e-06 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526226+0000", 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042462489999999997 2024-09-17T16:42:29.512 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526271+0000", 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4733e-05 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 55/34 ECSubWrite(tid=29, reqid=client.4553.0:374, at_version=55'23, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.526069+0000", 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.91605396299999997, 2024-09-17T16:42:29.513 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030150770000000001, 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526069+0000", 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526069+0000", 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526071+0000", 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0640000000000001e-06 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526286+0000", 2024-09-17T16:42:29.515 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000215269 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526298+0000", 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2567e-05 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526308+0000", 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9979999999999998e-06 2024-09-17T16:42:29.516 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526359+0000", 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1004000000000002e-05 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.526369+0000", 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0044000000000001e-05 2024-09-17T16:42:29.517 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.529050+0000", 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026808359999999998 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.529085+0000", 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4295000000000003e-05 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.518 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 55/34 ECSubWrite(tid=39, reqid=client.4553.0:386, at_version=55'14, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.598135+0000", 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.84398854400000001, 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042135949999999997, 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.519 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598135+0000", 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598135+0000", 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598135+0000", 2024-09-17T16:42:29.520 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2499999999999999e-07 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598567+0000", 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000432008 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598587+0000", 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9656e-05 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.521 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598596+0000", 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0739999999999999e-06 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598656+0000", 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0238999999999997e-05 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.598666+0000", 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0477e-05 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.522 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.602320+0000", 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036538759999999999 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.602348+0000", 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8140000000000002e-05 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.523 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 55/34 ECSubWrite(tid=40, reqid=client.4553.0:387, at_version=55'15, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.605449+0000", 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.83667484700000005, 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048884489999999996, 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.524 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605449+0000", 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605449+0000", 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605454+0000", 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9609999999999996e-06 2024-09-17T16:42:29.525 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605704+0000", 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00025033400000000001 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605718+0000", 2024-09-17T16:42:29.526 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4079e-05 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605726+0000", 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4430000000000003e-06 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605780+0000", 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3216e-05 2024-09-17T16:42:29.527 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.605788+0000", 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4169999999999992e-06 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.610298+0000", 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045098120000000002 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.528 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.610337+0000", 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9187000000000003e-05 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.606586+0000", 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.83553739800000004, 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004738524, 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.529 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606586+0000", 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606586+0000", 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.530 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606587+0000", 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3200000000000004e-07 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606920+0000", 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000333247 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606949+0000", 2024-09-17T16:42:29.531 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8739e-05 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606960+0000", 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0984e-05 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607024+0000", 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3856999999999995e-05 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.532 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607033+0000", 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6520000000000001e-06 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611289+0000", 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004256208 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.533 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611325+0000", 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5104999999999997e-05 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.611364+0000", 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.83075986400000001, 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0061945719999999998, 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.534 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611364+0000", 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611364+0000", 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.535 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611364+0000", 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4399999999999999e-07 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611746+0000", 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038204200000000003 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611758+0000", 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1124999999999999e-05 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.536 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611764+0000", 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6329999999999999e-06 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611814+0000", 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0034999999999998e-05 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611821+0000", 2024-09-17T16:42:29.537 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.148e-06 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.617527+0000", 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057053479999999998 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.617558+0000", 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1396999999999998e-05 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.538 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 55/34 ECSubWrite(tid=41, reqid=client.4553.0:388, at_version=55'16, trim_to=0'0, roll_forward_to=55'14))", 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.612000+0000", 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.83012310899999997, 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0029802119999999999, 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.539 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612000+0000", 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612000+0000", 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612001+0000", 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7899999999999997e-07 2024-09-17T16:42:29.540 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612178+0000", 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017694600000000001 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612194+0000", 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5852e-05 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.541 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612202+0000", 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4309999999999994e-06 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612261+0000", 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8514999999999998e-05 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612271+0000", 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.995e-06 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.542 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.614950+0000", 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026795450000000002 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.614981+0000", 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0049e-05 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.543 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.544 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:29.546 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:42:29.546 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:29.547 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:29.542+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:148: done (5 left) 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:149: done (4 left) 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:150: done (3 left) 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:151: done (2 left) 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:152: done (1 left) 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:153: done (0 left) 2024-09-17T16:42:29.549 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 49 current snap is 12 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:154: seq_num 79 ranges {819200=573440,1392640=425984,1818624=344064} 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:154: writing smithi18337221-49 from 819200 to 1392640 tid 1 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:154: writing smithi18337221-49 from 1392640 to 1818624 tid 2 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:154: writing smithi18337221-49 from 1818624 to 2162688 tid 3 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 1 current snap is 12 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:155: seq_num 80 ranges {491520=589824,1081344=573440,1654784=196608} 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:155: writing smithi18337221-1 from 491520 to 1081344 tid 1 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:155: writing smithi18337221-1 from 1081344 to 1654784 tid 2 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:155: writing smithi18337221-1 from 1654784 to 1851392 tid 3 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:156: snap_create 2024-09-17T16:42:29.550 INFO:tasks.rados.rados.0.smithi183.stdout:154: finishing write tid 1 to smithi18337221-49 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: finishing write tid 2 to smithi18337221-49 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: finishing write tid 3 to smithi18337221-49 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: finishing write tid 4 to smithi18337221-49 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: finishing write tid 5 to smithi18337221-49 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: oid 49 updating version 0 to 12 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: oid 49 updating version 12 to 13 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: oid 49 version 13 is already newer than 11 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:154: oid 49 version 13 is already newer than 10 2024-09-17T16:42:29.551 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 49 v 13 (ObjNum 79 snap 12 seq_num 79) dirty exists 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:154: left oid 49 (ObjNum 79 snap 12 seq_num 79) 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: finishing write tid 1 to smithi18337221-1 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: finishing write tid 2 to smithi18337221-1 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: finishing write tid 3 to smithi18337221-1 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: finishing write tid 4 to smithi18337221-1 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: finishing write tid 5 to smithi18337221-1 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: oid 1 updating version 0 to 73 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: oid 1 updating version 73 to 74 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: oid 1 version 74 is already newer than 72 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: oid 1 updating version 74 to 75 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 1 v 75 (ObjNum 80 snap 12 seq_num 80) dirty exists 2024-09-17T16:42:29.552 INFO:tasks.rados.rados.0.smithi183.stdout:155: left oid 1 (ObjNum 80 snap 12 seq_num 80) 2024-09-17T16:42:29.645 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:29.643+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:29.690 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:29.690 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:29.690 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:29.690 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:29.699 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:29.746 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:29.744+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:29.801 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:29.801 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:29.802 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:29.802 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:29.802 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:29.810 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:29.847 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:29.845+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4353.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 34.797541680999998, 2024-09-17T16:42:29.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019887846000000001, 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4353", 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 1 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:29.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114602+0000", 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4899999999999999e-06 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114608+0000", 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5269999999999998e-06 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114617+0000", 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114624+0000", 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:42:29.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114751+0000", 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012672599999999999 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114762+0000", 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0988000000000001e-05 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133140+0000", 2024-09-17T16:42:29.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018378205000000002 2024-09-17T16:42:29.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.920 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.920 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133255+0000", 2024-09-17T16:42:29.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011454 2024-09-17T16:42:29.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 5", 2024-09-17T16:42:29.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133361+0000", 2024-09-17T16:42:29.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106 2024-09-17T16:42:29.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.922 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2024-09-17T16:42:29.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134291+0000", 2024-09-17T16:42:29.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00092989899999999998 2024-09-17T16:42:29.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:29.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134428+0000", 2024-09-17T16:42:29.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013742100000000001 2024-09-17T16:42:29.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:29.924 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134460+0000", 2024-09-17T16:42:29.924 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1696000000000003e-05 2024-09-17T16:42:29.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134488+0000", 2024-09-17T16:42:29.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8839999999999998e-05 2024-09-17T16:42:29.925 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.925 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.926 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.926 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:180 3.8s0 3:1f669f2f:::smithi18337221-38:head [copy-from ver 4] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:29.926 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:29.927 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.451598305000001, 2024-09-17T16:42:29.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539511, 2024-09-17T16:42:29.927 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.927 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.927 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:29.927 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.928 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:29.928 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:29.928 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 180 2024-09-17T16:42:29.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.928 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.929 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.929 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:29.929 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:29.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460545+0000", 2024-09-17T16:42:29.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789999999999999e-06 2024-09-17T16:42:29.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460557+0000", 2024-09-17T16:42:29.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1426e-05 2024-09-17T16:42:29.932 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460574+0000", 2024-09-17T16:42:29.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7201e-05 2024-09-17T16:42:29.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460585+0000", 2024-09-17T16:42:29.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1151e-05 2024-09-17T16:42:29.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.934 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460659+0000", 2024-09-17T16:42:29.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3627000000000005e-05 2024-09-17T16:42:29.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:29.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460665+0000", 2024-09-17T16:42:29.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8799999999999996e-06 2024-09-17T16:42:29.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465756+0000", 2024-09-17T16:42:29.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050914580000000001 2024-09-17T16:42:29.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465824+0000", 2024-09-17T16:42:29.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7695999999999997e-05 2024-09-17T16:42:29.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.938 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.471499+0000", 2024-09-17T16:42:29.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056752800000000004 2024-09-17T16:42:29.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474733+0000", 2024-09-17T16:42:29.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336159999999999 2024-09-17T16:42:29.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:29.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475885+0000", 2024-09-17T16:42:29.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011522209999999999 2024-09-17T16:42:29.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.941 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475939+0000", 2024-09-17T16:42:29.941 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4075e-05 2024-09-17T16:42:29.941 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.941 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.942 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.942 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.942 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.942 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:181 3.8s0 3:1f669f2f:::smithi18337221-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:29.942 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:29.943 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.451535458999999, 2024-09-17T16:42:29.943 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012676972999999999, 2024-09-17T16:42:29.943 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.943 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.943 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:29.943 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.944 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:29.944 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:29.944 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 181 2024-09-17T16:42:29.944 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.945 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.945 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.945 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:29.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.945 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.946 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.946 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:29.946 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.947 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.947 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.947 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:29.947 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7700000000000005e-07 2024-09-17T16:42:29.947 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.948 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.948 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.948 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460610+0000", 2024-09-17T16:42:29.948 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.255e-06 2024-09-17T16:42:29.948 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.948 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460615+0000", 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4210000000000003e-06 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460619+0000", 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9580000000000001e-06 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460721+0000", 2024-09-17T16:42:29.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000101939 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460728+0000", 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8040000000000004e-06 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466017+0000", 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052897680000000002 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466075+0000", 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7250999999999998e-05 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473120+0000", 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070448159999999998 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473208+0000", 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8794000000000004e-05 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473284+0000", 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5489999999999997e-05 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:205 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~540672] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.425538415999998, 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022798883999999998, 2024-09-17T16:42:29.952 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 205 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486616+0000", 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2235999999999999e-05 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487273+0000", 2024-09-17T16:42:29.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065649800000000004 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487287+0000", 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4691e-05 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487297+0000", 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6360000000000006e-06 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488723+0000", 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014264239999999999 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488837+0000", 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011340000000000001 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490257+0000", 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014198100000000001 2024-09-17T16:42:29.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503813+0000", 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013556586000000001 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509302+0000", 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054885029999999996 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:42:29.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001011 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:206 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.422357907999999, 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020001278000000001, 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:29.958 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 206 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:29.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489787+0000", 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.193e-06 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490081+0000", 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029397100000000002 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490112+0000", 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1084999999999998e-05 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490123+0000", 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1440999999999999e-05 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498510+0000", 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083867290000000008 2024-09-17T16:42:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498626+0000", 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011602700000000001 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499572+0000", 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00094589999999999995 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504786+0000", 2024-09-17T16:42:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005214148 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509716+0000", 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049301520000000001 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509786+0000", 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9632e-05 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.963 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:207 3.8s0 3:1b608a02:::smithi18337221-50:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.421999726999999, 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020510362000000001, 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:29.964 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 207 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490149+0000", 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.135e-06 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490157+0000", 2024-09-17T16:42:29.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9060000000000002e-06 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490162+0000", 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1229999999999999e-06 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505559+0000", 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539709 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.967 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505695+0000", 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135969 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506337+0000", 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064216000000000002 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507545+0000", 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012081609999999999 2024-09-17T16:42:29.968 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510574+0000", 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030285519999999999 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510653+0000", 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9348e-05 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:208 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.421971666000001, 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021610111000000001, 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 208 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.970 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:29.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490174+0000", 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7350000000000001e-06 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490181+0000", 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9890000000000003e-06 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490186+0000", 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2299999999999999e-06 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506594+0000", 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016408049000000001 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507224+0000", 2024-09-17T16:42:29.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000629881 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510953+0000", 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037285399999999998 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511114+0000", 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016097400000000001 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511781+0000", 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066716099999999999 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=24, reqid=client.4553.0:217, at_version=40'7, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.414736655999999, 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077578639999999997, 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.975 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.976 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497406+0000", 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.41e-07 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497426+0000", 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0489999999999999e-05 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497452+0000", 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5528e-05 2024-09-17T16:42:29.977 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.497458+0000", 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8510000000000004e-06 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503461+0000", 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060033170000000002 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503471+0000", 2024-09-17T16:42:29.978 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7669999999999998e-06 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505129+0000", 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016584410000000001 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505164+0000", 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4128999999999998e-05 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.979 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.413483368000001, 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086096929999999999, 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:29.980 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498660+0000", 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2399999999999996e-07 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.981 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498679+0000", 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9306000000000001e-05 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498692+0000", 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3247999999999999e-05 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498711+0000", 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8244e-05 2024-09-17T16:42:29.982 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503918+0000", 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052073960000000004 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503938+0000", 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0027999999999999e-05 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.983 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507239+0000", 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033006559999999999 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507269+0000", 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9890999999999999e-05 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=26, reqid=client.4553.0:219, at_version=40'9, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:29.984 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.412309509, 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074558929999999999, 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.985 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499833+0000", 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499852+0000", 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8698e-05 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.986 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499864+0000", 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1633e-05 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499873+0000", 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0860000000000008e-06 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504903+0000", 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050303450000000003 2024-09-17T16:42:29.987 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504912+0000", 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8219999999999996e-06 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507272+0000", 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0023596450000000001 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507289+0000", 2024-09-17T16:42:29.988 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7033000000000001e-05 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.411632762, 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074193640000000003, 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.989 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500510+0000", 2024-09-17T16:42:29.990 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9800000000000002e-07 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500667+0000", 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156265 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500697+0000", 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9807000000000001e-05 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.991 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500706+0000", 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7599999999999997e-06 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500843+0000", 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013689600000000001 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500852+0000", 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3720000000000005e-06 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.992 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507885+0000", 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070330829999999999 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507929+0000", 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4283000000000003e-05 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.993 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s1 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 11.403700389000001, 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088156980000000003, 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.994 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509059+0000", 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00061633200000000003 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.995 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509089+0000", 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9966000000000001e-05 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509098+0000", 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509196+0000", 2024-09-17T16:42:29.996 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7888999999999997e-05 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509204+0000", 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1289999999999996e-06 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517216+0000", 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008012 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:29.997 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517258+0000", 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1189000000000002e-05 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 6.4507073669999997, 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092754329999999996, 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:29.998 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:29.999 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0399999999999996e-07 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461889+0000", 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045319700000000002 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461900+0000", 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1837e-05 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.000 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461909+0000", 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3590000000000008e-06 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461957+0000", 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8575999999999997e-05 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461963+0000", 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7699999999999998e-06 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.001 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.470674+0000", 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0087108930000000008 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.470710+0000", 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6297000000000002e-05 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs2 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:42:30.002 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.473595+0000", 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 6.4385471389999998, 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076802540000000001, 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.473595+0000", 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.003 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.473595+0000", 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.473596+0000", 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8000000000000005e-07 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474252+0000", 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065578999999999995 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.004 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474262+0000", 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0266e-05 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474269+0000", 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1579999999999999e-06 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474327+0000", 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7454999999999998e-05 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.005 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.474336+0000", 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4709999999999996e-06 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481249+0000", 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069131849999999996 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481275+0000", 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6149e-05 2024-09-17T16:42:30.006 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 55/34 ECSubWrite(tid=128, reqid=osd.2.0:128, at_version=55'26, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.481764+0000", 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.43037781, 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077338049999999998, 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.007 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.481764+0000", 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.481764+0000", 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.481765+0000", 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.54e-07 2024-09-17T16:42:30.008 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.481784+0000", 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8267999999999999e-05 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.481792+0000", 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8529999999999998e-06 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.481799+0000", 2024-09-17T16:42:30.009 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0739999999999998e-06 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.483818+0000", 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0020193379999999999 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.483827+0000", 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1740000000000006e-06 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.010 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489409+0000", 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0055820349999999999 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.489498+0000", 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9209000000000006e-05 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:367 3.8s0 3:1b608a02:::smithi18337221-50:b [read 0~1753088,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:30.011 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.409525795, 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082445369999999997, 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 367 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.012 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.23e-07 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.013 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502623+0000", 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0959999999999997e-06 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502634+0000", 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0899e-05 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502642+0000", 2024-09-17T16:42:30.014 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3209999999999999e-06 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505267+0000", 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002625643 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505339+0000", 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1939000000000004e-05 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.015 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510861+0000", 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0055218159999999997 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:368 3.8s0 3:1b608a02:::smithi18337221-50:b [read 1295654~457434,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.4094843180000001, 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0099805280000000007, 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:30.016 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 368 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:30.017 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502659+0000", 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502663+0000", 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0269999999999997e-06 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.018 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502670+0000", 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502676+0000", 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3269999999999997e-06 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510962+0000", 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082857139999999996 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.019 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.511066+0000", 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010427199999999999 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512639+0000", 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015722690000000001 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502730+0000", 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.4094125040000001, 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074173390000000002, 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502730+0000", 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502730+0000", 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502731+0000", 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3699999999999999e-07 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.022 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.503214+0000", 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048375799999999999 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.503225+0000", 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0871e-05 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.503234+0000", 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1309999999999995e-06 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.023 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.503304+0000", 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9268000000000002e-05 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.503311+0000", 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5079999999999999e-06 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510117+0000", 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068055779999999996 2024-09-17T16:42:30.024 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510147+0000", 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0388000000000001e-05 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.305202736, 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011225425000000001, 2024-09-17T16:42:30.025 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.026 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606941+0000", 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0869999999999999e-06 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607290+0000", 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034908900000000002 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607308+0000", 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8522999999999999e-05 2024-09-17T16:42:30.027 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607322+0000", 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3582e-05 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607407+0000", 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5463000000000005e-05 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607417+0000", 2024-09-17T16:42:30.028 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6090000000000007e-06 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618132+0000", 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010714672999999999 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618165+0000", 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3399000000000003e-05 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.029 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.611870+0000", 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.300271832, 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075076739999999998, 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611870+0000", 2024-09-17T16:42:30.030 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611870+0000", 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611872+0000", 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1540000000000001e-06 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.031 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612309+0000", 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00043699800000000002 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612321+0000", 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2371999999999999e-05 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612329+0000", 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3939999999999996e-06 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.032 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612384+0000", 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4407000000000003e-05 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612393+0000", 2024-09-17T16:42:30.033 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5759999999999995e-06 2024-09-17T16:42:30.036 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.036 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.036 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.619338+0000", 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069442599999999998 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.619378+0000", 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0513000000000003e-05 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.037 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:30.039 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:30.040 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:30.037+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:30.081 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:30.139 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:30.137+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:30.142 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:30.142 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:30.142 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:30.143 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:30.151 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:30.219 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:30.238 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:30.241 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:30.239+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:30.252 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:30.252 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:30.252 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:30.252 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:30.252 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:30.256 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:30.261 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:30.273 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:30.273 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:30.289 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:30.289 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:30.306 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:30.307 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:30.324 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:30.324 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:30.342 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:30.340+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:30.342 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:30.342 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:30.359 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpRead(3.9s3 40/34 ECSubRead(tid=20, to_read={3:97a3b59a:::smithi18337221-19:head=0,77824,0}, subchunks={3:97a3b59a:::smithi18337221-19:head=[0,1]}, attrs_to_read=))", 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.883311819999999, 2024-09-17T16:42:30.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0034770349999999998, 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480664+0000", 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.79e-07 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480671+0000", 2024-09-17T16:42:30.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8090000000000004e-06 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480690+0000", 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9426e-05 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480702+0000", 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1494999999999999e-05 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.480784+0000", 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2408000000000001e-05 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484141+0000", 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033567179999999999 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.873138785999998, 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080373609999999998, 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9900000000000001e-07 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490977+0000", 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000139412 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490997+0000", 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.052e-05 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491011+0000", 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4304999999999999e-05 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491130+0000", 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011833900000000001 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491143+0000", 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2986000000000001e-05 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498835+0000", 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076927319999999999 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498874+0000", 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8668000000000003e-05 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499738+0000", 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.864237880000001, 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0042740529999999999, 2024-09-17T16:42:30.377 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499738+0000", 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.378 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499738+0000", 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499739+0000", 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2550000000000001e-06 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499883+0000", 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014423699999999999 2024-09-17T16:42:30.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499901+0000", 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8097999999999999e-05 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499911+0000", 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8619999999999998e-06 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499974+0000", 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3220999999999997e-05 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499994+0000", 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9525999999999999e-05 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503965+0000", 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0039709860000000001 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504012+0000", 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6867999999999999e-05 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.863401192000001, 2024-09-17T16:42:30.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062103369999999998, 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500574+0000", 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500575+0000", 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8000000000000002e-07 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501024+0000", 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00044916500000000001 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501041+0000", 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6782e-05 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501050+0000", 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9670000000000007e-06 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501115+0000", 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5790000000000005e-05 2024-09-17T16:42:30.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.501125+0000", 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5710000000000004e-06 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506743+0000", 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056177629999999996 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506785+0000", 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2018999999999999e-05 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 11.855771756999999, 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0091817740000000002, 2024-09-17T16:42:30.387 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:30.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.91e-07 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508622+0000", 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041787699999999998 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508636+0000", 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4331999999999999e-05 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508644+0000", 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508713+0000", 2024-09-17T16:42:30.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9888000000000006e-05 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508723+0000", 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.713e-06 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517349+0000", 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086254179999999993 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517386+0000", 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6971000000000002e-05 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=31, reqid=client.4553.0:252, at_version=45'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.514637+0000", 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 11.849338211999999, 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0035639069999999998, 2024-09-17T16:42:30.392 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514637+0000", 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.393 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514637+0000", 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514638+0000", 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5999999999999991e-07 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514870+0000", 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00023161199999999999 2024-09-17T16:42:30.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514887+0000", 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7186000000000001e-05 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514897+0000", 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0125999999999999e-05 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514953+0000", 2024-09-17T16:42:30.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6030999999999999e-05 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.514962+0000", 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9099999999999994e-06 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.518157+0000", 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031950540000000001 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.518201+0000", 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4027999999999999e-05 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:270 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~655360] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.843539888, 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013861503000000001, 2024-09-17T16:42:30.397 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 270 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520438+0000", 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0849999999999999e-06 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520784+0000", 2024-09-17T16:42:30.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034672700000000002 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520799+0000", 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4945e-05 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520809+0000", 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999997e-06 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520888+0000", 2024-09-17T16:42:30.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9523000000000004e-05 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.521021+0000", 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013319300000000001 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522568+0000", 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015468770000000001 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085082820000000007 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534240+0000", 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031634889999999998 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534297+0000", 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.402 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:271 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.841144762000001, 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01199191, 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.403 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 271 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522833+0000", 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.889e-06 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523129+0000", 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029651599999999998 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523150+0000", 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0537e-05 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523159+0000", 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2329999999999995e-06 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527318+0000", 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041587719999999998 2024-09-17T16:42:30.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527398+0000", 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0752000000000002e-05 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527918+0000", 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051932300000000003 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531167+0000", 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032495649999999998 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534786+0000", 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036188050000000001 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534823+0000", 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6517999999999998e-05 2024-09-17T16:42:30.408 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:272 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.840796340000001, 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011828584, 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.409 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 272 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523180+0000", 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523184+0000", 2024-09-17T16:42:30.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1989999999999999e-06 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523202+0000", 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7932999999999999e-05 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523210+0000", 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5050000000000001e-06 2024-09-17T16:42:30.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530456+0000", 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072466300000000004 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3615999999999995e-05 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530847+0000", 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032758 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531332+0000", 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048465900000000002 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534949+0000", 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036167159999999999 2024-09-17T16:42:30.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535008+0000", 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9038e-05 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:273 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.840753488000001, 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012586701, 2024-09-17T16:42:30.415 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 273 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523223+0000", 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523226+0000", 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2150000000000001e-06 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9100000000000005e-06 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523241+0000", 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1899999999999998e-06 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531097+0000", 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078564370000000008 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531159+0000", 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535259+0000", 2024-09-17T16:42:30.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041002670000000003 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535355+0000", 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5707999999999999e-05 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535809+0000", 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045409299999999998 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWriteReply(3.3s0 46/34 ECSubWriteReply(tid=19, last_complete=46'12, committed=1, applied=1))", 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.527945+0000", 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.836030183, 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031321180000000001, 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527945+0000", 2024-09-17T16:42:30.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527945+0000", 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527946+0000", 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7700000000000004e-07 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527950+0000", 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2130000000000002e-06 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527960+0000", 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8500000000000006e-06 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527966+0000", 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7989999999999999e-06 2024-09-17T16:42:30.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531060+0000", 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030939399999999999 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7538999999999999e-05 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:297 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~737280] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 6.8819854639999996, 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011819003, 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 297 2024-09-17T16:42:30.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481992+0000", 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.001e-06 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482367+0000", 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037461699999999999 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482382+0000", 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5693e-05 2024-09-17T16:42:30.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482389+0000", 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.08e-06 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482440+0000", 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0917000000000001e-05 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482445+0000", 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6410000000000001e-06 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484030+0000", 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001585328 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484091+0000", 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0677999999999997e-05 2024-09-17T16:42:30.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.485118+0000", 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010273400000000001 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493041+0000", 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079222289999999994 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493728+0000", 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00068753100000000001 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493809+0000", 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0947999999999998e-05 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.431 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:298 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 6.8796215199999997, 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011840491999999999, 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 298 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.432 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484355+0000", 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0249999999999999e-06 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484537+0000", 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018172699999999999 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484548+0000", 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1202999999999999e-05 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484555+0000", 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4839999999999998e-06 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489700+0000", 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051447760000000002 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489765+0000", 2024-09-17T16:42:30.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4311000000000001e-05 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.490228+0000", 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046323600000000001 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493079+0000", 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028515580000000001 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:30.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496152+0000", 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030726970000000001 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496195+0000", 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2475000000000002e-05 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:299 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 6.8794032549999997, 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01186708, 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 299 2024-09-17T16:42:30.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484573+0000", 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2399999999999998e-07 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484576+0000", 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4920000000000002e-06 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484582+0000", 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.096e-06 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484587+0000", 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2390000000000002e-06 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492444+0000", 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078571289999999992 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492500+0000", 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5806000000000001e-05 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492763+0000", 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00026361899999999998 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493177+0000", 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041339600000000001 2024-09-17T16:42:30.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496387+0000", 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032098970000000002 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496439+0000", 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2781999999999997e-05 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:300 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 6.879380222, 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012900164, 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.444 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 300 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484596+0000", 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.63e-07 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484599+0000", 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1690000000000001e-06 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484607+0000", 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484612+0000", 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1379999999999998e-06 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492930+0000", 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083180240000000003 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492979+0000", 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9021999999999999e-05 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496702+0000", 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037230459999999998 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496783+0000", 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1225999999999998e-05 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.497495+0000", 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00071229699999999997 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:30.449 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.515145+0000", 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.8488306670000001, 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060780529999999999, 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515145+0000", 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515145+0000", 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515145+0000", 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.02e-07 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515396+0000", 2024-09-17T16:42:30.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00025053500000000003 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515410+0000", 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4569999999999999e-05 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515419+0000", 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0960000000000007e-06 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515493+0000", 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3490000000000003e-05 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.515503+0000", 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0276e-05 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521187+0000", 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056837249999999997 2024-09-17T16:42:30.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.521223+0000", 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6259e-05 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.522077+0000", 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.841898925, 2024-09-17T16:42:30.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065037330000000003, 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522077+0000", 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522077+0000", 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522087+0000", 2024-09-17T16:42:30.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0462000000000001e-05 2024-09-17T16:42:30.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522266+0000", 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017935100000000001 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522278+0000", 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1764e-05 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522286+0000", 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9559999999999997e-06 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522358+0000", 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1983000000000005e-05 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.522367+0000", 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7660000000000004e-06 2024-09-17T16:42:30.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.528511+0000", 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0061438159999999999 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.528580+0000", 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9635000000000007e-05 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:382 3.3s0 3:cea69da5:::smithi18337221-40:head [read 0~671744,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.590052+0000", 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.7739236759999999, 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.003802237, 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 382 2024-09-17T16:42:30.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590052+0000", 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590052+0000", 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590052+0000", 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8900000000000001e-07 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590064+0000", 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2170999999999999e-05 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590069+0000", 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4299999999999999e-06 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590072+0000", 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.05e-06 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590685+0000", 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00061335800000000005 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.590760+0000", 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5234999999999994e-05 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.593854+0000", 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030937040000000001 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.607019+0000", 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.7569563480000001, 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051377660000000002, 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607019+0000", 2024-09-17T16:42:30.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607019+0000", 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607021+0000", 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.347e-06 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607312+0000", 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029124199999999999 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607333+0000", 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0964000000000001e-05 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607345+0000", 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2187e-05 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607436+0000", 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0988000000000004e-05 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607466+0000", 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9844000000000001e-05 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612123+0000", 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004657347 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612157+0000", 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3847000000000003e-05 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.611938+0000", 2024-09-17T16:42:30.469 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.7520379240000001, 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006585296, 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611938+0000", 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:30.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611938+0000", 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611939+0000", 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8299999999999995e-07 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612296+0000", 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00035731800000000002 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612312+0000", 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5815e-05 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612321+0000", 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5789999999999993e-06 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612509+0000", 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018813599999999999 2024-09-17T16:42:30.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612519+0000", 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5589999999999994e-06 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618487+0000", 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059682199999999998 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618523+0000", 2024-09-17T16:42:30.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5785999999999999e-05 2024-09-17T16:42:30.474 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.474 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.474 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.474 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:30.474 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:30.474 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:30.474 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:30.474 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:30.474 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-17T16:42:30.474 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T16:42:30.475 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T16:42:30.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-17T16:42:30.476 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:30.477 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:30.477 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:30.477 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:30.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:30.478 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:30.479 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:30.479 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:30.479 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:30.479 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:30.480 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:30.480 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:30.481 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:30.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:30.466+0000 7f06e2758640 0 -- 172.21.15.60:0/1327039841 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f06dc224270 msgr2=0x7f06dc226660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:30.481 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:30.474+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:30.485 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:30.485 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:30.485 INFO:tasks.rados.rados.0.smithi183.stdout:154: done (2 left) 2024-09-17T16:42:30.486 INFO:tasks.rados.rados.0.smithi183.stdout:155: done (1 left) 2024-09-17T16:42:30.486 INFO:tasks.rados.rados.0.smithi183.stdout:156: done (0 left) 2024-09-17T16:42:30.486 INFO:tasks.rados.rados.0.smithi183.stdout:157: snap_remove snap 11 2024-09-17T16:42:30.578 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:30.575+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:30.589 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:30.589 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T16:42:30.590 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:30.590 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:30.590 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:30.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:30.679 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:30.677+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:30.746 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:30.747 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:30.755 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:30.780 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:30.778+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:30.862 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:30.862 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:30.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:30.881 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:30.878+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:30.978 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:30.978 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:30.981 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:30.979+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:30.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:31.082 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:31.080+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:31.135 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.135 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.144 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:31.188 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:31.186+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:31.252 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.252 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.261 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:31.284 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:31.281+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:31.385 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:31.383+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:31.408 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.408 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:31.485 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:31.483+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:31.500 INFO:tasks.rados.rados.0.smithi183.stdout:157: done (0 left) 2024-09-17T16:42:31.500 INFO:tasks.rados.rados.0.smithi183.stdout:158: snap_remove snap 7 2024-09-17T16:42:31.524 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.524 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:31.548 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:42:31.587 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:31.585+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:31.685 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.685 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.687 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:31.685+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:31.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:31.789 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:31.787+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:31.844 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.844 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:31.890 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:31.888+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:31.960 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:31.960 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:31.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:32.013 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:32.011+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:32.076 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:32.077 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:32.085 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:32.091 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:32.089+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:32.193 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:32.190+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:32.202 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:32.202 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:32.211 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:32.293 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:32.291+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:32.314 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:32.314 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:32.323 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:32.394 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:32.392+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:32.466 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:32.466 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:32.474 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:32.494 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:32.492+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:32.496 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:42:32.498 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:32.500 INFO:tasks.rados.rados.0.smithi183.stdout:158: done (0 left) 2024-09-17T16:42:32.500 INFO:tasks.rados.rados.0.smithi183.stdout:159: delete oid 46 current snap is 13 2024-09-17T16:42:32.511 INFO:tasks.rados.rados.0.smithi183.stdout:159: done (0 left) 2024-09-17T16:42:32.511 INFO:tasks.rados.rados.0.smithi183.stdout:160: setattr oid 50 current snap is 13 2024-09-17T16:42:32.513 INFO:tasks.rados.rados.0.smithi183.stdout:161: rollback oid 13 current snap is 13 2024-09-17T16:42:32.513 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 13 to 12 2024-09-17T16:42:32.513 INFO:tasks.rados.rados.0.smithi183.stdout:162: rollback oid 3 current snap is 13 2024-09-17T16:42:32.513 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 3 to 12 2024-09-17T16:42:32.514 INFO:tasks.rados.rados.0.smithi183.stdout:163: read oid 32 snap 6 2024-09-17T16:42:32.514 INFO:tasks.rados.rados.0.smithi183.stdout:163: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:32.514 INFO:tasks.rados.rados.0.smithi183.stdout:164: setattr oid 39 current snap is 13 2024-09-17T16:42:32.515 INFO:tasks.rados.rados.0.smithi183.stdout:165: snap_remove snap 10 2024-09-17T16:42:32.589 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:32.589 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:32.595 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:32.593+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:32.597 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:32.639 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:32.639 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:32.656 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:32.657 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:32.673 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:32.674 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:32.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:32.696 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:32.694+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:32.700 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:32.700 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:32.706 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:32.707 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:32.708 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:32.723 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:32.724 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:32.741 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:32.758 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:32.758 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:32.774 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:32.774 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:32.790 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:32.790 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:32.796 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:32.794+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:32.808 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:32.825 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:32.826 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:32.841 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:32.842 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:187 3.cs0 3:385cb74d:::smithi18337221-1:head [copy-from ver 8] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373999351999998, 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.039364976000000003, 2024-09-17T16:42:32.855 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 187 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477631+0000", 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477644+0000", 2024-09-17T16:42:32.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2748999999999999e-05 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477673+0000", 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8603e-05 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477688+0000", 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5454000000000001e-05 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477843+0000", 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015473799999999999 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8953e-05 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480146+0000", 2024-09-17T16:42:32.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022843439999999998 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480220+0000", 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3986999999999995e-05 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510626+0000", 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030406048000000001 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515100+0000", 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044740450000000003 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516938+0000", 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001837736 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516994+0000", 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6045000000000003e-05 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:188 3.cs0 3:385cb74d:::smithi18337221-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373893379999998, 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.036238998000000001, 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.862 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 188 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:32.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477736+0000", 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.494e-06 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477742+0000", 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8930000000000002e-06 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477763+0000", 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0942999999999999e-05 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477781+0000", 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7479999999999999e-05 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019260600000000001 2024-09-17T16:42:32.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477980+0000", 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4829999999999996e-06 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480439+0000", 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024594259999999998 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480480+0000", 2024-09-17T16:42:32.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0512000000000001e-05 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513848+0000", 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033368666999999998 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513906+0000", 2024-09-17T16:42:32.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513974+0000", 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8291000000000001e-05 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.868 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:189 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477805+0000", 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373823587, 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012842599, 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.869 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 189 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477805+0000", 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477805+0000", 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477806+0000", 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.15e-06 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477811+0000", 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2530000000000004e-06 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477828+0000", 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7283e-05 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477842+0000", 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3337e-05 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478019+0000", 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00017758300000000001 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478023+0000", 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2610000000000002e-06 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480513+0000", 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024901680000000001 2024-09-17T16:42:32.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480572+0000", 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9490999999999997e-05 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481392+0000", 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00082016599999999999 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483656+0000", 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022633929999999998 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490571+0000", 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069147260000000004 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490647+0000", 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6787999999999997e-05 2024-09-17T16:42:32.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:190 3.cs0 3:3f892186:::smithi18337221-33:head [rollback 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477860+0000", 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373768148, 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012958247000000001, 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.877 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 190 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477860+0000", 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477860+0000", 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477861+0000", 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2999999999999999e-07 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477866+0000", 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0969999999999996e-06 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477897+0000", 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0783e-05 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477922+0000", 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4666999999999999e-05 2024-09-17T16:42:32.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478055+0000", 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013373700000000001 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478062+0000", 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4139999999999999e-06 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481914+0000", 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038522199999999999 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481963+0000", 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9237999999999999e-05 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047424099999999997 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483971+0000", 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015334610000000001 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490781+0000", 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068098000000000004 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490818+0000", 2024-09-17T16:42:32.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7659e-05 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:191 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373699682000002, 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020837920999999999, 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.884 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 191 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:32.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477932+0000", 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2389999999999998e-06 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477939+0000", 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8530000000000003e-06 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477944+0000", 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3279999999999999e-06 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478088+0000", 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014464 2024-09-17T16:42:32.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478091+0000", 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6900000000000001e-06 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482685+0000", 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045939370000000002 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482783+0000", 2024-09-17T16:42:32.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8634000000000005e-05 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483160+0000", 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000376645 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.484086+0000", 2024-09-17T16:42:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000926092 2024-09-17T16:42:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498688+0000", 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014601930000000001 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498767+0000", 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8502000000000002e-05 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:192 3.cs0 3:3e21370b:::smithi18337221-11:head [copy-from ver 6] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.891 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373665713000001, 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028471962999999999, 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 192 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999999e-07 2024-09-17T16:42:32.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477966+0000", 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0769999999999999e-06 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5239999999999997e-06 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477976+0000", 2024-09-17T16:42:32.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2399999999999999e-06 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478121+0000", 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145038 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478126+0000", 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4480000000000002e-06 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483386+0000", 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052599209999999999 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483472+0000", 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6159e-05 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492564+0000", 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090913120000000007 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.501360+0000", 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008796313 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506376+0000", 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050161659999999999 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506435+0000", 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8354999999999999e-05 2024-09-17T16:42:32.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:193 3.cs0 3:3e21370b:::smithi18337221-11:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.373646633, 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020602901, 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.898 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 193 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477983+0000", 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3909999999999999e-06 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477992+0000", 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5669999999999995e-06 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477995+0000", 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9119999999999998e-06 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478149+0000", 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153695 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478153+0000", 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5990000000000004e-06 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483619+0000", 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054658809999999997 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483650+0000", 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1115999999999998e-05 2024-09-17T16:42:32.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498397+0000", 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014746853000000001 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498485+0000", 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8203999999999998e-05 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:42:32.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9411000000000001e-05 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:266 3.cs0 3:3f892186:::smithi18337221-33:head [create,setxattr Y`URWapPpbRbcVnVY`QSNsZaZVYgbfr]kcmrp_g\\ (35) in=40b,setxattr QSnNfhP`\\rbs^]tkaRf]mXj_]bm_arNTstOQjkpY (1332) in=40b,setxattr YOlbral_g[Tac`rkYhXkaidaYfloWs]f`[kfmoeq (1402) in=40b,setxattr O\\Up[arf_O^_OTehidgQm\\_dWqiOgZeddoq[Yeim (421) in=40b,setxattr OliOVUW (1227) in=7b,setxattr mRZhPnOqZXai[tb[_iYpr_fWU`VpVZePspesWXth (9612) in=40b,setxattr p`]Nq_ParoVlgZ_RfOmdYljgitUhq[nn^STkQnm\\ (489) in=40b,setxattr gac_OaSTa[cilYpd\\TYRomd[_[t]lkbeSfUstbbO (385) in=40b,setxattr [^knka[\\][o`oZ[XWVa\\nRZ_^]h[\\ZPq`fqVZUm` (13472) in=40b,setxattr paYr[ki]Uj^gZYZXoSk]OhhpsdnXbWSQNQUhgNgp (1649) in=40b,setxattr SXYNfcNts[adfhlcih^SbYXacRgpdjjt_UedQoso (1789) in=40b,setxattr SsZS^dPc\\fk]ZQjgZ[i]iageNpNcccY^_QpkmcZR (1121) in=40b,setxattr cbOj`RWijYOTWkn\\Sk\\N_a[otcWhlc_kPXhaQhtm (1402) in=40b,setxattr fddhrQT_f\\R (1227) in=11b,setxattr jffqjeh^Weeqcg^`^Wa]]on^og\\VRjnkZqT\\oRWq (243) in=40b,setxattr i[eniSaVsaY_koZilr\\[qpYgN_PenNUPlN\\hNr]Z (1929) in=40b,setxattr Sbtooedescb]TlUVZR^hh[icrap_aWR^_mTZalnt (1963) in=40b,setxattr iYtRdsiUT^YaZcYqmPkOTbnaa_c^ (1227) in=28b,setxattr ao`Z_^XlrOjfeg]XV`]_[il^OU]]def]hmcaTagQ (349) in=40b,setxattr gg]bVkQeTo]\\ji^ph[UbnhXh_aaWYaTU_mQp`lPf (3576) in=40b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.341023044, 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018237339000000002, 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.904 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 266 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510606+0000", 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5099999999999998e-07 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510781+0000", 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174525 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510796+0000", 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5435999999999999e-05 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510804+0000", 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3969999999999997e-06 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510859+0000", 2024-09-17T16:42:32.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5102999999999997e-05 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510863+0000", 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3959999999999999e-06 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.516079+0000", 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052157760000000001 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.516181+0000", 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101841 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517216+0000", 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010352790000000001 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.518703+0000", 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014866829999999999 2024-09-17T16:42:32.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528773+0000", 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010070608999999999 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528843+0000", 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9443000000000006e-05 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es2 55/34 ECSubWrite(tid=129, reqid=client.4553.0:353, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.490298+0000", 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3613305179999999, 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012786921999999999, 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490298+0000", 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490298+0000", 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490299+0000", 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7399999999999991e-07 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490587+0000", 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028861199999999999 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490599+0000", 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1443999999999999e-05 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490608+0000", 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3249999999999997e-06 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490682+0000", 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3986999999999995e-05 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490689+0000", 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3980000000000004e-06 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503036+0000", 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012347548999999999 2024-09-17T16:42:32.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503085+0000", 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8633e-05 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es2 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.496329+0000", 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3552995719999998, 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012895548, 2024-09-17T16:42:32.915 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496329+0000", 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496329+0000", 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496344+0000", 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.518e-05 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496599+0000", 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025489399999999998 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496626+0000", 2024-09-17T16:42:32.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7313000000000001e-05 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496636+0000", 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6369999999999994e-06 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496697+0000", 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1669999999999997e-05 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.496708+0000", 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0232e-05 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.509176+0000", 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012468706 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.509224+0000", 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7916e-05 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.919 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:362 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~491520] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.497212+0000", 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.35441682, 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017300221000000001, 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.920 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 362 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497212+0000", 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497212+0000", 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497214+0000", 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0389999999999999e-06 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497773+0000", 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055930400000000005 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497788+0000", 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5338000000000001e-05 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497797+0000", 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.303e-06 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497864+0000", 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7650000000000005e-05 2024-09-17T16:42:32.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497945+0000", 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0926000000000004e-05 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.498805+0000", 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000859423 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.511457+0000", 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012652682 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514458+0000", 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030005029999999999 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514512+0000", 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4052999999999999e-05 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.925 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:365 3.cs0 3:38e3a789:::smithi18337221-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.503640+0000", 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3479879390000002, 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013332376, 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 365 2024-09-17T16:42:32.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503640+0000", 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503640+0000", 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503641+0000", 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5300000000000004e-07 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503645+0000", 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.737e-06 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503652+0000", 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0740000000000004e-06 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503657+0000", 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.271e-06 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.511691+0000", 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0080336650000000006 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.511802+0000", 2024-09-17T16:42:32.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000111496 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515415+0000", 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036131800000000001 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515494+0000", 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8529999999999995e-05 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.516973+0000", 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00147887 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:400 3.5s0 3:a48bc8c8:::smithi18337221-49:head [append 0~573440] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.490194+0000", 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3614348359999999, 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016574993, 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.931 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 400 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.490194+0000", 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.490194+0000", 2024-09-17T16:42:32.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.490196+0000", 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9560000000000002e-06 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491001+0000", 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00080424700000000001 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491017+0000", 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6269e-05 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491045+0000", 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7888000000000001e-05 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491112+0000", 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7385999999999995e-05 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491198+0000", 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5674999999999995e-05 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492356+0000", 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011577639999999999 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506268+0000", 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013912143 2024-09-17T16:42:32.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506589+0000", 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000320728 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506769+0000", 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179937 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:401 3.5s0 3:a48bc8c8:::smithi18337221-49:head [append 0~425984] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492593+0000", 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3590358249999999, 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014356555, 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 401 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.937 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492593+0000", 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492593+0000", 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492594+0000", 2024-09-17T16:42:32.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4950000000000001e-06 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.493125+0000", 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053070400000000001 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.493142+0000", 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7169000000000001e-05 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.493152+0000", 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6520000000000001e-06 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.496453+0000", 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033016299999999998 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.496538+0000", 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5179999999999994e-05 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497382+0000", 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084374799999999996 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506273+0000", 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088910970000000006 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506861+0000", 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000587753 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506949+0000", 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8127000000000005e-05 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:402 3.5s0 3:a48bc8c8:::smithi18337221-49:head [append 0~344064] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494475+0000", 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3571529240000002, 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014544682999999999, 2024-09-17T16:42:32.942 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 402 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494475+0000", 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494475+0000", 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494477+0000", 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3349999999999999e-06 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494812+0000", 2024-09-17T16:42:32.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033566500000000002 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494827+0000", 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4827999999999999e-05 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494834+0000", 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7819999999999996e-06 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500331+0000", 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054966019999999997 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500429+0000", 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7842000000000003e-05 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501127+0000", 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069878699999999998 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506371+0000", 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052436050000000001 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.508945+0000", 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025742769999999998 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.509020+0000", 2024-09-17T16:42:32.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4960000000000001e-05 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:403 3.5s0 3:a48bc8c8:::smithi18337221-49:head [setxattr _header (57) in=7b] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3567785350000001, 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016737051999999999, 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.948 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 403 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:32.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9999999999999997e-07 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494853+0000", 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8660000000000002e-06 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494859+0000", 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8239999999999996e-06 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494863+0000", 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6509999999999999e-06 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505091+0000", 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010228671999999999 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.951 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505201+0000", 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109677 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505801+0000", 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059984700000000003 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506786+0000", 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098517299999999999 2024-09-17T16:42:32.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.511487+0000", 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047005040000000003 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.511587+0000", 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100238 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:404 3.5s0 3:a48bc8c8:::smithi18337221-49:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3567595880000001, 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017980659999999999, 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 404 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.954 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9400000000000001e-07 2024-09-17T16:42:32.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494871+0000", 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5069999999999999e-06 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494876+0000", 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2689999999999999e-06 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494879+0000", 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1499999999999999e-06 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506094+0000", 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011215163 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506241+0000", 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014708899999999999 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512022+0000", 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057804579999999996 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512109+0000", 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6910999999999995e-05 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512849+0000", 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074081899999999998 2024-09-17T16:42:32.958 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:405 3.cs0 3:385cb74d:::smithi18337221-1:head [append 0~589824] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.500132+0000", 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3514963660000001, 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015556489, 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.959 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 405 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500132+0000", 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500132+0000", 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500134+0000", 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5659999999999999e-06 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500796+0000", 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066278300000000001 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.961 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500808+0000", 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1772e-05 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500815+0000", 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3050000000000004e-06 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500875+0000", 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9521000000000002e-05 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500974+0000", 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8547000000000004e-05 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.502145+0000", 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011713590000000001 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512582+0000", 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010437428 2024-09-17T16:42:32.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.515610+0000", 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030276349999999999 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.515688+0000", 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8572999999999995e-05 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:406 3.cs0 3:385cb74d:::smithi18337221-1:head [append 0~573440] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.503285+0000", 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3483434719999998, 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012927925, 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 406 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.965 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.503285+0000", 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.503285+0000", 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.503287+0000", 2024-09-17T16:42:32.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.03e-06 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.503866+0000", 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00057952000000000004 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.503884+0000", 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7691000000000001e-05 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.503893+0000", 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1670000000000005e-06 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.508039+0000", 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041454669999999999 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.508130+0000", 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1516999999999998e-05 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.508973+0000", 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084298100000000003 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.515705+0000", 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067316279999999999 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.516167+0000", 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00046189799999999997 2024-09-17T16:42:32.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.516213+0000", 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6026000000000003e-05 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:409 3.cs0 3:385cb74d:::smithi18337221-1:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.505335+0000", 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3462936280000002, 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012429802, 2024-09-17T16:42:32.970 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 409 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505335+0000", 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:32.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505335+0000", 2024-09-17T16:42:32.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:32.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505336+0000", 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0800000000000004e-07 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505341+0000", 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4500000000000003e-06 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505351+0000", 2024-09-17T16:42:32.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7890000000000006e-06 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505358+0000", 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8750000000000002e-06 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.517071+0000", 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011713309999999999 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:32.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.517164+0000", 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3022999999999993e-05 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.517765+0000", 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060054699999999999 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:32.975 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:32.976 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:32.977 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:32.977 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:32.978 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:32.978 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:32.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:32.888+0000 7f28913b3640 0 -- 172.21.15.60:0/270719412 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f288c224230 msgr2=0x7f288c226620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:32.979 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:32.979 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:32.980 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:32.974+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:33.078 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:33.076+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:33.083 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:33.083 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:33.083 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:33.083 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:33.091 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:33.179 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:33.177+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:33.194 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:33.195 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:33.195 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:33.203 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:33.280 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:33.278+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:33.307 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.806513915, 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048787229999999997, 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.308 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498548+0000", 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6599999999999996e-07 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498566+0000", 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7934000000000001e-05 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498578+0000", 2024-09-17T16:42:33.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1769e-05 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498583+0000", 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7769999999999999e-06 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498647+0000", 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3689000000000006e-05 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.311 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498657+0000", 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3740000000000004e-06 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503393+0000", 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004736428 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503426+0000", 2024-09-17T16:42:33.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3086000000000001e-05 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=26, reqid=client.4553.0:219, at_version=40'9, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499781+0000", 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.805280069999998, 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036671590000000001, 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.313 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499781+0000", 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499781+0000", 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499782+0000", 2024-09-17T16:42:33.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9299999999999998e-07 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499797+0000", 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5494000000000001e-05 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499813+0000", 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5316e-05 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499819+0000", 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7089999999999996e-06 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499887+0000", 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8113000000000003e-05 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499896+0000", 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:42:33.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503429+0000", 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035329559999999999 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503448+0000", 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9633999999999999e-05 2024-09-17T16:42:33.317 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.804773774000001, 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091284039999999997, 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500288+0000", 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8799999999999998e-07 2024-09-17T16:42:33.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500609+0000", 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000321482 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500624+0000", 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4558e-05 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500632+0000", 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500693+0000", 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1045999999999998e-05 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500703+0000", 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9899999999999992e-06 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509375+0000", 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086724420000000007 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509416+0000", 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0639000000000002e-05 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.78230143, 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010249355999999999, 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2e-07 2024-09-17T16:42:33.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523388+0000", 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062798599999999997 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523412+0000", 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3898999999999999e-05 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523422+0000", 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0259e-05 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523489+0000", 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7070000000000007e-05 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523500+0000", 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0617e-05 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532963+0000", 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009463183 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533009+0000", 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5921999999999998e-05 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.327 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=20, reqid=client.4553.0:271, at_version=46'13, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.776977756000001, 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053659780000000004, 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528084+0000", 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:33.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228254 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528326+0000", 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.366e-05 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528334+0000", 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3000000000000002e-06 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529561+0000", 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226293 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529570+0000", 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5820000000000008e-06 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533417+0000", 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003846576 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533449+0000", 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2694000000000002e-05 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=21, reqid=client.4553.0:272, at_version=46'14, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.530892+0000", 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 13.774168755, 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002853151, 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.332 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530892+0000", 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530892+0000", 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530893+0000", 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1200000000000001e-07 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530916+0000", 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2920000000000001e-05 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530933+0000", 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6707000000000001e-05 2024-09-17T16:42:33.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530942+0000", 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6570000000000003e-06 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532783+0000", 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001841295 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532795+0000", 2024-09-17T16:42:33.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1789e-05 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533712+0000", 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00091691099999999996 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533746+0000", 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.396e-05 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.336 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.8199298509999995, 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081612969999999996, 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485132+0000", 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5699999999999999e-07 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485905+0000", 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077313100000000004 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485917+0000", 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2092999999999999e-05 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485924+0000", 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7700000000000004e-06 2024-09-17T16:42:33.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485987+0000", 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3487999999999999e-05 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485998+0000", 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0917000000000001e-05 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493262+0000", 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072639489999999996 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493293+0000", 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0791999999999999e-05 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.341 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 50/34 ECSubWrite(tid=28, reqid=client.4553.0:298, at_version=50'17, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.490404+0000", 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.81465751, 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033874489999999998, 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490404+0000", 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490404+0000", 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490405+0000", 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0999999999999997e-07 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490744+0000", 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000339685 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490763+0000", 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8660000000000001e-05 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490773+0000", 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6379999999999999e-06 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490836+0000", 2024-09-17T16:42:33.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3349999999999995e-05 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.490846+0000", 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5400000000000001e-06 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493752+0000", 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029061030000000002 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493791+0000", 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9563000000000001e-05 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 55/34 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=55'24, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.489448+0000", 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8156128210000002, 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037358420000000001, 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489448+0000", 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489448+0000", 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489449+0000", 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8699999999999999e-07 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489475+0000", 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6349000000000001e-05 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489484+0000", 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3600000000000002e-06 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489491+0000", 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3829999999999997e-06 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489551+0000", 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9951999999999998e-05 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.489559+0000", 2024-09-17T16:42:33.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3559999999999993e-06 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493146+0000", 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035868889999999998 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493184+0000", 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8365999999999998e-05 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7903176670000001, 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014931335, 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.99e-07 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515242+0000", 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049758300000000001 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515257+0000", 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.502e-05 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515265+0000", 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515335+0000", 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9536000000000006e-05 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515345+0000", 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9240000000000002e-06 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529639+0000", 2024-09-17T16:42:33.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014294526 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529675+0000", 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:33.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7832965139999999, 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081458920000000001, 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521766+0000", 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5700000000000001e-07 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522010+0000", 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024482600000000002 2024-09-17T16:42:33.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522025+0000", 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.484e-05 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522035+0000", 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000001e-06 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522101+0000", 2024-09-17T16:42:33.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5848999999999999e-05 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522111+0000", 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0122000000000001e-05 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529879+0000", 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077677559999999998 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529911+0000", 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=29, reqid=client.4553.0:374, at_version=55'23, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.526115+0000", 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7789461790000001, 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040460779999999998, 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.360 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526115+0000", 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526115+0000", 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526116+0000", 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4099999999999998e-07 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526232+0000", 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116276 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526243+0000", 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.046e-05 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526248+0000", 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7250000000000002e-06 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526736+0000", 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048768100000000001 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526748+0000", 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1558e-05 2024-09-17T16:42:33.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.530125+0000", 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033771270000000002 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.530161+0000", 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6510000000000001e-05 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=30, reqid=client.4553.0:375, at_version=55'24, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.528750+0000", 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.7763112410000002, 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039889879999999997, 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.528750+0000", 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.528750+0000", 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.528751+0000", 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.75e-07 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.528765+0000", 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4783999999999999e-05 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.528776+0000", 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0560000000000001e-05 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.528783+0000", 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2309999999999999e-06 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529721+0000", 2024-09-17T16:42:33.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00093802800000000004 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529732+0000", 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0451e-05 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.532707+0000", 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0029750890000000002 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.532739+0000", 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2169999999999999e-05 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6984312800000003, 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048852510000000002, 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.369 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.370 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606632+0000", 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.547e-06 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607055+0000", 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042362999999999998 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607075+0000", 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0128000000000001e-05 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.371 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607086+0000", 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0705e-05 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607170+0000", 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4061999999999996e-05 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607181+0000", 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1430000000000001e-05 2024-09-17T16:42:33.372 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611472+0000", 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042906589999999996 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611515+0000", 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.373 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6936649900000003, 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008221562, 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.374 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.375 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611397+0000", 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.71e-07 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611941+0000", 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000544269 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.376 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611963+0000", 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1710999999999999e-05 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611973+0000", 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612053+0000", 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0012999999999994e-05 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.377 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612087+0000", 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4171999999999997e-05 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619590+0000", 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075029110000000001 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619618+0000", 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7461999999999999e-05 2024-09-17T16:42:33.378 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=35, reqid=client.4553.0:396, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6865933059999998, 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062462430000000003, 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.379 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618469+0000", 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-17T16:42:33.380 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618513+0000", 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618529+0000", 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6183000000000001e-05 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.381 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618538+0000", 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618616+0000", 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8300999999999995e-05 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618627+0000", 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0750999999999999e-05 2024-09-17T16:42:33.382 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624677+0000", 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060503570000000001 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624714+0000", 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6786999999999999e-05 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.383 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=36, reqid=client.4553.0:397, at_version=55'29, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6847346979999998, 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004607384, 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.384 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2499999999999995e-07 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620342+0000", 2024-09-17T16:42:33.385 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4865000000000001e-05 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620357+0000", 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5098e-05 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620366+0000", 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4889999999999995e-06 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.386 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620411+0000", 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5411000000000003e-05 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620416+0000", 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624906+0000", 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044902270000000003 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624934+0000", 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.745e-05 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.388 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8126049220000002, 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079871060000000008, 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492457+0000", 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-07 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492641+0000", 2024-09-17T16:42:33.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184215 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492656+0000", 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279000000000001e-05 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492704+0000", 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7738000000000003e-05 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492882+0000", 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177906 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492916+0000", 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4110999999999999e-05 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500404+0000", 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074877750000000003 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.392 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500443+0000", 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9724000000000001e-05 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=106, reqid=client.4553.0:401, at_version=56'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.497410+0000", 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8076513580000002, 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003566647, 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.393 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497410+0000", 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497410+0000", 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497411+0000", 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2299999999999999e-07 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497526+0000", 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000114762 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497539+0000", 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3345e-05 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497551+0000", 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2062000000000001e-05 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497627+0000", 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5575999999999996e-05 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497636+0000", 2024-09-17T16:42:33.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3000000000000007e-06 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500945+0000", 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033086449999999998 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500977+0000", 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2033999999999999e-05 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.397 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=107, reqid=client.4553.0:402, at_version=56'12, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.501227+0000", 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.8038341300000003, 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030914330000000002, 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501227+0000", 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501227+0000", 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501228+0000", 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.85e-07 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501308+0000", 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9529000000000004e-05 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501323+0000", 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5722e-05 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501333+0000", 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6520000000000001e-06 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501403+0000", 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0463999999999995e-05 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501411+0000", 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2049999999999996e-06 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.504276+0000", 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028651950000000001 2024-09-17T16:42:33.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.504319+0000", 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2781000000000003e-05 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.402 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:33.404 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:33.404 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:33.402+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:33.505 INFO:tasks.rados.rados.0.smithi183.stdout:165: done (5 left) 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:166: read oid 33 snap -1 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:166: expect (ObjNum 68 snap 10 seq_num 68) 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:167: rollback oid 5 current snap is 13 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 5 to 6 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:168: setattr oid 23 current snap is 13 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 50 v 19 (ObjNum 54 snap 2 seq_num 54) dirty exists 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 39 v 4 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-17T16:42:33.506 INFO:tasks.rados.rados.0.smithi183.stdout:162: finishing rollback tid 0 to smithi18337221-3 2024-09-17T16:42:33.507 INFO:tasks.rados.rados.0.smithi183.stdout:163: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:33.507 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 113145 2024-09-17T16:42:33.507 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:33.503+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:33.507 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 83224 2024-09-17T16:42:33.509 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.511 INFO:tasks.rados.rados.0.smithi183.stdout:162: finishing rollback tid 1 to smithi18337221-3 2024-09-17T16:42:33.511 INFO:tasks.rados.rados.0.smithi183.stdout:161: finishing rollback tid 0 to smithi18337221-13 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:162: finishing rollback tid 2 to smithi18337221-3 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 3 v 30 (ObjNum 66 snap 9 seq_num 66) dirty exists 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:161: finishing rollback tid 1 to smithi18337221-13 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:161: finishing rollback tid 2 to smithi18337221-13 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 13 v 37 (ObjNum 76 snap 11 seq_num 76) dirty exists 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:160: done (7 left) 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:161: done (6 left) 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:162: done (5 left) 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:163: done (4 left) 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:164: done (3 left) 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 2 current snap is 13 2024-09-17T16:42:33.512 INFO:tasks.rados.rados.0.smithi183.stdout:169: seq_num 82 ranges {32768=622592,655360=475136,1130496=294912} 2024-09-17T16:42:33.515 INFO:tasks.rados.rados.0.smithi183.stdout:169: writing smithi18337221-2 from 32768 to 655360 tid 1 2024-09-17T16:42:33.519 INFO:tasks.rados.rados.0.smithi183.stdout:169: writing smithi18337221-2 from 655360 to 1130496 tid 2 2024-09-17T16:42:33.521 INFO:tasks.rados.rados.0.smithi183.stdout:169: writing smithi18337221-2 from 1130496 to 1425408 tid 3 2024-09-17T16:42:33.522 INFO:tasks.rados.rados.0.smithi183.stdout:170: delete oid 50 current snap is 13 2024-09-17T16:42:33.522 INFO:tasks.rados.rados.0.smithi183.stdout:167: finishing rollback tid 0 to smithi18337221-5 2024-09-17T16:42:33.522 INFO:tasks.rados.rados.0.smithi183.stdout:167: finishing rollback tid 1 to smithi18337221-5 2024-09-17T16:42:33.522 INFO:tasks.rados.rados.0.smithi183.stdout:167: finishing rollback tid 2 to smithi18337221-5 2024-09-17T16:42:33.522 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 5 v 23 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-17T16:42:33.526 INFO:tasks.rados.rados.0.smithi183.stdout:166: expect (ObjNum 68 snap 10 seq_num 68) 2024-09-17T16:42:33.530 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 691106 2024-09-17T16:42:33.551 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1683278 2024-09-17T16:42:33.551 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.559 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:33.560 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:33.560 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:33.560 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:33.569 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:33.573 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 23 v 91 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-09-17T16:42:33.573 INFO:tasks.rados.rados.0.smithi183.stdout:169: finishing write tid 1 to smithi18337221-2 2024-09-17T16:42:33.573 INFO:tasks.rados.rados.0.smithi183.stdout:169: finishing write tid 2 to smithi18337221-2 2024-09-17T16:42:33.573 INFO:tasks.rados.rados.0.smithi183.stdout:169: finishing write tid 3 to smithi18337221-2 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:166: done (4 left) 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:167: done (3 left) 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:168: done (2 left) 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:170: done (1 left) 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:171: read oid 42 snap -1 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:171: expect deleted 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:172: rollback oid 30 current snap is 13 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 30 to 12 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:169: finishing write tid 4 to smithi18337221-2 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:169: finishing write tid 5 to smithi18337221-2 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:169: oid 2 updating version 0 to 21 2024-09-17T16:42:33.574 INFO:tasks.rados.rados.0.smithi183.stdout:169: oid 2 version 21 is already newer than 19 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:169: oid 2 updating version 21 to 22 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:169: oid 2 version 22 is already newer than 20 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 2 v 22 (ObjNum 82 snap 13 seq_num 82) dirty exists 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:169: left oid 2 (ObjNum 82 snap 13 seq_num 82) 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:169: done (2 left) 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:173: read oid 28 snap -1 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:173: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:174: read oid 19 snap -1 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:174: expect deleted 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:175: read oid 23 snap 12 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:175: expect (ObjNum 22 snap 0 seq_num 22) 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 13 current snap is 13 2024-09-17T16:42:33.575 INFO:tasks.rados.rados.0.smithi183.stdout:176: seq_num 84 ranges {2424832=655360,3080192=638976,3719168=131072} 2024-09-17T16:42:33.588 INFO:tasks.rados.rados.0.smithi183.stdout:176: writing smithi18337221-13 from 2424832 to 3080192 tid 1 2024-09-17T16:42:33.592 INFO:tasks.rados.rados.0.smithi183.stdout:176: writing smithi18337221-13 from 3080192 to 3719168 tid 2 2024-09-17T16:42:33.593 INFO:tasks.rados.rados.0.smithi183.stdout:176: writing smithi18337221-13 from 3719168 to 3850240 tid 3 2024-09-17T16:42:33.593 INFO:tasks.rados.rados.0.smithi183.stdout:177: read oid 29 snap -1 2024-09-17T16:42:33.593 INFO:tasks.rados.rados.0.smithi183.stdout:177: expect (ObjNum 60 snap 5 seq_num 60) 2024-09-17T16:42:33.593 INFO:tasks.rados.rados.0.smithi183.stdout:178: setattr oid 37 current snap is 13 2024-09-17T16:42:33.593 INFO:tasks.rados.rados.0.smithi183.stdout:173: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:42:33.594 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 197942 2024-09-17T16:42:33.597 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.604 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 294249 2024-09-17T16:42:33.605 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:33.603+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:33.606 INFO:tasks.rados.rados.0.smithi183.stdout:172: finishing rollback tid 0 to smithi18337221-30 2024-09-17T16:42:33.606 INFO:tasks.rados.rados.0.smithi183.stdout:172: finishing rollback tid 1 to smithi18337221-30 2024-09-17T16:42:33.606 INFO:tasks.rados.rados.0.smithi183.stdout:172: finishing rollback tid 2 to smithi18337221-30 2024-09-17T16:42:33.606 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 30 v 61 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T16:42:33.606 INFO:tasks.rados.rados.0.smithi183.stdout:175: expect (ObjNum 22 snap 0 seq_num 22) 2024-09-17T16:42:33.606 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.612 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 313767 2024-09-17T16:42:33.613 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 77073 2024-09-17T16:42:33.616 INFO:tasks.rados.rados.0.smithi183.stdout:176: finishing write tid 1 to smithi18337221-13 2024-09-17T16:42:33.616 INFO:tasks.rados.rados.0.smithi183.stdout:177: expect (ObjNum 60 snap 5 seq_num 60) 2024-09-17T16:42:33.617 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.631 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.648 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:33.665 INFO:tasks.rados.rados.0.smithi183.stdout:176: finishing write tid 2 to smithi18337221-13 2024-09-17T16:42:33.665 INFO:tasks.rados.rados.0.smithi183.stdout:176: finishing write tid 3 to smithi18337221-13 2024-09-17T16:42:33.665 INFO:tasks.rados.rados.0.smithi183.stdout:176: finishing write tid 4 to smithi18337221-13 2024-09-17T16:42:33.665 INFO:tasks.rados.rados.0.smithi183.stdout:176: finishing write tid 5 to smithi18337221-13 2024-09-17T16:42:33.665 INFO:tasks.rados.rados.0.smithi183.stdout:176: oid 13 updating version 0 to 42 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:176: oid 13 updating version 42 to 44 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:176: oid 13 updating version 44 to 45 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:176: oid 13 version 45 is already newer than 43 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 13 v 45 (ObjNum 84 snap 13 seq_num 84) dirty exists 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:176: left oid 13 (ObjNum 84 snap 13 seq_num 84) 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 35 (ObjNum 71 snap 10 seq_num 71) dirty exists 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:171: done (7 left) 2024-09-17T16:42:33.668 INFO:tasks.rados.rados.0.smithi183.stdout:172: done (6 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:173: done (5 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:174: done (4 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:175: done (3 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:176: done (2 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:177: done (1 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:178: done (0 left) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:179: read oid 24 snap 9 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:179: expect (ObjNum 48 snap 0 seq_num 48) 2024-09-17T16:42:33.669 INFO:tasks.rados.rados.0.smithi183.stdout:180: snap_remove snap 6 2024-09-17T16:42:33.678 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:33.678 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:33.678 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:33.678 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:33.678 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:33.687 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:33.706 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:33.704+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:33.791 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4353.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.666231697999997, 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085139050000000004, 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.792 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4353", 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 7 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122525+0000", 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122527+0000", 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.813e-06 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122536+0000", 2024-09-17T16:42:33.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5769999999999994e-06 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122551+0000", 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5962999999999999e-05 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122563+0000", 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1556000000000001e-05 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122628+0000", 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4994999999999997e-05 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.122635+0000", 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5560000000000004e-06 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129375+0000", 2024-09-17T16:42:33.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067407320000000001 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129461+0000", 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5228000000000005e-05 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for subops from 12", 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.129559+0000", 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8362000000000005e-05 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op_commit", 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130320+0000", 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000760741 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130958+0000", 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00063790199999999998 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.130991+0000", 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3543000000000001e-05 2024-09-17T16:42:33.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:41:57.131039+0000", 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7936999999999999e-05 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:250 3.fs0 3:f9fe778d:::smithi18337221-39:head [read 85634~553342,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:18.499787+0000", 2024-09-17T16:42:33.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.288969438000001, 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087966339999999994, 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 250 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499787+0000", 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499787+0000", 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499788+0000", 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9399999999999995e-07 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499791+0000", 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7970000000000001e-06 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499798+0000", 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0550000000000002e-06 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499804+0000", 2024-09-17T16:42:33.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.857e-06 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499909+0000", 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010507599999999999 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.499915+0000", 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9920000000000004e-06 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.506933+0000", 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0070181369999999998 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.507042+0000", 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109089 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:18.508584+0000", 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015421370000000001 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.804 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:259 3.as0 3:50831259:::smithi18337221-29:head [append 0~638976] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.281186356999999, 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022736635000000002, 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.805 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 259 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507573+0000", 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508317+0000", 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074403399999999997 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508341+0000", 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4454999999999999e-05 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508353+0000", 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2255e-05 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508427+0000", 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3428000000000002e-05 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508437+0000", 2024-09-17T16:42:33.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8279999999999998e-06 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510471+0000", 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020343150000000001 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510530+0000", 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9429999999999999e-05 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511483+0000", 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000952596 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522459+0000", 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010975805 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530227+0000", 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077686020000000003 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530307+0000", 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9647000000000005e-05 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:260 3.as0 3:50831259:::smithi18337221-29:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.279196431000001, 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020894380000000001, 2024-09-17T16:42:33.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509561+0000", 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0470000000000001e-06 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510123+0000", 2024-09-17T16:42:33.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00056148700000000005 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510133+0000", 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.025e-05 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510140+0000", 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0129999999999996e-06 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519266+0000", 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091254409999999998 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519325+0000", 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9122000000000001e-05 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519798+0000", 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047354100000000001 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523708+0000", 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039092340000000001 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530404+0000", 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066966009999999999 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530455+0000", 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0643999999999998e-05 2024-09-17T16:42:33.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:261 3.as0 3:50831259:::smithi18337221-29:head [setxattr _header (56) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.278603901, 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439715000000001, 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.817 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 261 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:42:33.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510154+0000", 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.16e-07 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510157+0000", 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5949999999999999e-06 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510163+0000", 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.993e-06 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510168+0000", 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8620000000000002e-06 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522482+0000", 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012313691 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522554+0000", 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1983999999999994e-05 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522957+0000", 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040297599999999999 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.524157+0000", 2024-09-17T16:42:33.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011998950000000001 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063637449999999996 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530593+0000", 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2157999999999996e-05 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:262 3.as0 3:50831259:::smithi18337221-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.278581467, 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021519231999999999, 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 262 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510176+0000", 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4700000000000002e-07 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510178+0000", 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9649999999999998e-06 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510184+0000", 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2489999999999998e-06 2024-09-17T16:42:33.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510189+0000", 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9649999999999999e-06 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523572+0000", 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013382955 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523660+0000", 2024-09-17T16:42:33.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8460000000000003e-05 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530953+0000", 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072929079999999999 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.531043+0000", 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9289000000000005e-05 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.531695+0000", 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065199400000000003 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s3 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 14.265914881, 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011272473, 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.828 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.48e-07 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523557+0000", 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071461699999999996 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523570+0000", 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2876e-05 2024-09-17T16:42:33.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523578+0000", 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2339999999999994e-06 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523644+0000", 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6023000000000001e-05 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523653+0000", 2024-09-17T16:42:33.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9570000000000008e-06 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.534081+0000", 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010428031000000001 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.534114+0000", 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3487e-05 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.327466358000001, 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011363906, 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461291+0000", 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3700000000000001e-07 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461780+0000", 2024-09-17T16:42:33.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048932100000000003 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461798+0000", 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461808+0000", 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0628000000000001e-05 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461901+0000", 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2238999999999996e-05 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461919+0000", 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8389999999999998e-05 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.472621+0000", 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701965000000001 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.472654+0000", 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3382e-05 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.cs2 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3023358759999999, 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009062779, 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.837 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486422+0000", 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1900000000000001e-07 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486443+0000", 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1484999999999998e-05 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486460+0000", 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6645000000000001e-05 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486467+0000", 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4499999999999998e-06 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486524+0000", 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7099999999999999e-05 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486531+0000", 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3160000000000002e-06 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.495444+0000", 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089135640000000006 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.495484+0000", 2024-09-17T16:42:33.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9400000000000002e-05 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.7s6 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.493670+0000", 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2950872750000002, 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085866209999999991, 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.842 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493670+0000", 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493670+0000", 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493671+0000", 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0100000000000001e-06 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493945+0000", 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027435099999999999 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493957+0000", 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2162e-05 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493963+0000", 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1580000000000002e-06 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.494023+0000", 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9825999999999999e-05 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.494033+0000", 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0063e-05 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.502212+0000", 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081793600000000001 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.502256+0000", 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3690999999999999e-05 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.846 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.502809+0000", 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.2859473919999997, 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086127489999999994, 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.502809+0000", 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.502809+0000", 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.502810+0000", 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1699999999999997e-07 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503221+0000", 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041110300000000001 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503279+0000", 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7250999999999998e-05 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503289+0000", 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0093e-05 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503429+0000", 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000139746 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.503438+0000", 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6490000000000003e-06 2024-09-17T16:42:33.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.511386+0000", 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.007947773 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.511422+0000", 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6217000000000002e-05 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:386 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~524288] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1922147619999999, 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014318277000000001, 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 386 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.852 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596544+0000", 2024-09-17T16:42:33.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.734e-06 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597029+0000", 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048475200000000002 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597043+0000", 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4173e-05 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597050+0000", 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597102+0000", 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1535e-05 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597175+0000", 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3429000000000005e-05 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598023+0000", 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084855 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610455+0000", 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012431143 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610790+0000", 2024-09-17T16:42:33.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033497699999999997 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610860+0000", 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0720000000000001e-05 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:387 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~524288] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1891782129999999, 2024-09-17T16:42:33.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014991211000000001, 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 387 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:42:33.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599580+0000", 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.291e-06 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600184+0000", 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060389600000000003 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600201+0000", 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.681e-05 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600209+0000", 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604101+0000", 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038916070000000001 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604228+0000", 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126787 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605024+0000", 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079670200000000004 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610981+0000", 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059569289999999997 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614498+0000", 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035168930000000001 2024-09-17T16:42:33.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614570+0000", 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1735000000000004e-05 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:388 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~245760] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1878212589999997, 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016358692000000001, 2024-09-17T16:42:33.863 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 388 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600937+0000", 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601238+0000", 2024-09-17T16:42:33.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030118700000000002 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601251+0000", 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2916e-05 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601258+0000", 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611153+0000", 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098949710000000007 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611232+0000", 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8889999999999999e-05 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611928+0000", 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069601799999999996 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.867 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614731+0000", 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028030020000000002 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617241+0000", 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025097890000000001 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617294+0000", 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3643999999999997e-05 2024-09-17T16:42:33.868 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:389 3.as0 3:53f17c76:::smithi18337221-27:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1874871450000004, 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016157145000000001, 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.869 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 389 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.92e-07 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601274+0000", 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3289999999999998e-06 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601282+0000", 2024-09-17T16:42:33.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2009999999999999e-06 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601288+0000", 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000002e-06 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.613675+0000", 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012386642 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.613763+0000", 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7653999999999998e-05 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614215+0000", 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000451939 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.616836+0000", 2024-09-17T16:42:33.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002621483 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617370+0000", 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000534243 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617427+0000", 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6431999999999998e-05 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.874 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:390 3.as0 3:53f17c76:::smithi18337221-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1874610639999998, 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017251170999999999, 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:33.875 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 390 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4000000000000002e-07 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601298+0000", 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2859999999999998e-06 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601306+0000", 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6820000000000003e-06 2024-09-17T16:42:33.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601311+0000", 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0869999999999997e-06 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614799+0000", 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013488061000000001 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614854+0000", 2024-09-17T16:42:33.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4469000000000003e-05 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617735+0000", 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002881125 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617783+0000", 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7617999999999997e-05 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618547+0000", 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076440299999999998 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWriteReply(3.as0 55/34 ECSubWriteReply(tid=39, last_complete=55'14, committed=1, applied=1))", 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601996+0000", 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1867608040000004, 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084602930000000007, 2024-09-17T16:42:33.880 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601996+0000", 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601996+0000", 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601997+0000", 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5199999999999996e-07 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602002+0000", 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2050000000000001e-06 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602017+0000", 2024-09-17T16:42:33.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4917e-05 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602028+0000", 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1644999999999999e-05 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610424+0000", 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0083955760000000001 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610456+0000", 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2298000000000001e-05 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWriteReply(3.as0 55/34 ECSubWriteReply(tid=39, last_complete=55'14, committed=1, applied=1))", 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.602108+0000", 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1866487250000004, 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084642239999999994, 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602108+0000", 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602108+0000", 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602109+0000", 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5300000000000003e-07 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602114+0000", 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8389999999999997e-06 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602129+0000", 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5614999999999999e-05 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602137+0000", 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.311e-06 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610548+0000", 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084116969999999992 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610572+0000", 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3909000000000001e-05 2024-09-17T16:42:33.887 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWriteReply(3.as0 55/34 ECSubWriteReply(tid=39, last_complete=55'14, committed=1, applied=1))", 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.602148+0000", 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1866087629999997, 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084736299999999994, 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602148+0000", 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602148+0000", 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602149+0000", 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602154+0000", 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2329999999999997e-06 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602166+0000", 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2119999999999999e-05 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.602173+0000", 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1789999999999996e-06 2024-09-17T16:42:33.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610607+0000", 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084346939999999995 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610622+0000", 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4477e-05 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.1s1 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.26987944000000003, 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012458881, 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518878+0000", 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2900000000000003e-07 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519191+0000", 2024-09-17T16:42:33.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313271 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519201+0000", 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8900000000000002e-06 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519206+0000", 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1340000000000003e-06 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:33.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519254+0000", 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7649999999999999e-05 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519264+0000", 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0309000000000001e-05 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.531316+0000", 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012051976000000001 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:33.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.531336+0000", 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0021999999999999e-05 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:33.896 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:33.898 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:33.898 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:33.895+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:33.999 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:33.997+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:34.006 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:34.006 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:34.006 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.014 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:34.099 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:34.097+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:34.116 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.116 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:34.116 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:34.116 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:34.116 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.125 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:34.200 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:34.199+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:34.228 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:34.228 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.330652030000003, 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086420360000000005, 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:34.229 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.230 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.75e-07 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894845+0000", 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8599999999999998e-06 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894852+0000", 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4330000000000001e-06 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894858+0000", 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7429999999999996e-06 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.900998+0000", 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061399779999999999 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901039+0000", 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1009e-05 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903413+0000", 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023735090000000002 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903442+0000", 2024-09-17T16:42:34.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9348000000000001e-05 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903481+0000", 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8680999999999998e-05 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s2 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:34.234 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.734986782, 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080258499999999993, 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:34.235 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490504+0000", 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3899999999999999e-07 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490955+0000", 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045038100000000002 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.236 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490970+0000", 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4878000000000001e-05 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490979+0000", 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9340000000000001e-06 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.491052+0000", 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2410999999999995e-05 2024-09-17T16:42:34.237 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.491062+0000", 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0068000000000001e-05 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498496+0000", 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074337639999999998 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498530+0000", 2024-09-17T16:42:34.238 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4275e-05 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s4 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.703020233, 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091363109999999994, 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.239 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4900000000000002e-07 2024-09-17T16:42:34.240 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523191+0000", 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000720417 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523614+0000", 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042271600000000001 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523627+0000", 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2809999999999999e-05 2024-09-17T16:42:34.241 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523707+0000", 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0507999999999996e-05 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523719+0000", 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1701e-05 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.242 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531573+0000", 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078534969999999992 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531607+0000", 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4412999999999997e-05 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:287 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~704512] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.456509+0000", 2024-09-17T16:42:34.243 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.768982341999999, 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016711638000000001, 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 287 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.244 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.456509+0000", 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.456509+0000", 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.456512+0000", 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0029999999999999e-06 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.245 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457447+0000", 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093523599999999999 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457467+0000", 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9839000000000001e-05 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457480+0000", 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2914e-05 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.246 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457574+0000", 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3932999999999997e-05 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457581+0000", 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2969999999999998e-06 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459762+0000", 2024-09-17T16:42:34.247 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002180885 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459841+0000", 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9351999999999995e-05 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.461106+0000", 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001264598 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.248 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471826+0000", 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010720517000000001 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.473100+0000", 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012736150000000001 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.473220+0000", 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120449 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.249 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:288 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.766980086, 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018124781, 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.250 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 288 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.251 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458512+0000", 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.201e-06 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459021+0000", 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000508696 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459036+0000", 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4946000000000001e-05 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.252 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459044+0000", 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2330000000000006e-06 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459105+0000", 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2959999999999998e-06 2024-09-17T16:42:34.253 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467231+0000", 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081265810000000008 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467343+0000", 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111366 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.468193+0000", 2024-09-17T16:42:34.254 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085095400000000001 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472015+0000", 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038219119999999998 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476572+0000", 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045570619999999997 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.255 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476636+0000", 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3184999999999999e-05 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:289 3.es0 3:7af0cf48:::smithi18337221-43:head [setxattr _header (56) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.766427304, 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017770232, 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.256 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 289 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:34.257 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5199999999999996e-07 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459069+0000", 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.258 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459077+0000", 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459083+0000", 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3620000000000002e-06 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459130+0000", 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6876000000000003e-05 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.259 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459135+0000", 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3340000000000003e-06 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471144+0000", 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012009117999999999 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471236+0000", 2024-09-17T16:42:34.260 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2281999999999995e-05 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471658+0000", 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042205299999999998 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472216+0000", 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055826699999999999 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.261 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476768+0000", 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045520710000000004 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476834+0000", 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5445999999999996e-05 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:290 3.es0 3:7af0cf48:::smithi18337221-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:34.262 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.766392173, 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021360535999999999, 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 290 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.263 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:42:34.264 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459107+0000", 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2930000000000003e-06 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459115+0000", 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.208e-06 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459121+0000", 2024-09-17T16:42:34.265 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459161+0000", 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9637e-05 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459168+0000", 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3000000000000004e-06 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471869+0000", 2024-09-17T16:42:34.266 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012700899 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471947+0000", 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8330000000000004e-05 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.267 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477178+0000", 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052311160000000001 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477230+0000", 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1366999999999998e-05 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.480459+0000", 2024-09-17T16:42:34.268 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032295029999999999 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:353 3.es0 3:7af0cf48:::smithi18337221-43:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.74597859, 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030354281, 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.269 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 353 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:42:34.270 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479514+0000", 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4649999999999999e-06 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479520+0000", 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7910000000000001e-06 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.271 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479530+0000", 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0753e-05 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479539+0000", 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9260000000000006e-06 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479975+0000", 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043575500000000002 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.272 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480105+0000", 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013020600000000001 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490191+0000", 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010086247 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501337+0000", 2024-09-17T16:42:34.273 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011145446999999999 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509772+0000", 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084349049999999995 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509867+0000", 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4785999999999997e-05 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.274 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:354 3.es0 3:7af0cf48:::smithi18337221-43:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.479564+0000", 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7459269299999995, 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015648311000000002, 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 354 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.275 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479564+0000", 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479564+0000", 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.276 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479565+0000", 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479569+0000", 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3059999999999999e-06 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.277 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479576+0000", 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1040000000000001e-06 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479582+0000", 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9410000000000004e-06 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480367+0000", 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078543099999999995 2024-09-17T16:42:34.278 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480400+0000", 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2573999999999997e-05 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495023+0000", 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01462282 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495108+0000", 2024-09-17T16:42:34.279 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5399e-05 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495212+0000", 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010411700000000001 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:355 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~475136] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:42:34.280 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.737390521, 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022143336, 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 355 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:42:34.281 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488102+0000", 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1119999999999999e-06 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.282 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488993+0000", 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089148899999999998 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489004+0000", 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1270000000000001e-05 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489012+0000", 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9729999999999997e-06 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.283 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495281+0000", 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062688559999999997 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495381+0000", 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100233 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496316+0000", 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093481 2024-09-17T16:42:34.284 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509884+0000", 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013567932 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510170+0000", 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028624299999999999 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510244+0000", 2024-09-17T16:42:34.285 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3417999999999994e-05 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWriteReply(3.es0 55/34 ECSubWriteReply(tid=128, last_complete=55'26, committed=1, applied=1))", 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7358971460000001, 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011740087999999999, 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.286 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2099999999999996e-07 2024-09-17T16:42:34.287 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489599+0000", 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.707e-06 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489608+0000", 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2499999999999995e-06 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.288 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489619+0000", 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0648e-05 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501127+0000", 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011507455999999999 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.289 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501334+0000", 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020730600000000001 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:356 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~622592] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7333402949999996, 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01999051, 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.290 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 356 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.291 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492153+0000", 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.911e-06 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.292 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492881+0000", 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072854300000000001 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492894+0000", 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2435e-05 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492902+0000", 2024-09-17T16:42:34.293 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-06 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501528+0000", 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086269080000000008 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501643+0000", 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011425399999999999 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.294 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502627+0000", 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098378000000000007 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509887+0000", 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072604310000000003 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512095+0000", 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022076079999999998 2024-09-17T16:42:34.295 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512141+0000", 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6570999999999998e-05 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:357 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~147456] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7325732379999996, 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020343033999999999, 2024-09-17T16:42:34.296 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 357 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.297 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8800000000000002e-07 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492986+0000", 2024-09-17T16:42:34.298 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7827e-05 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492993+0000", 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8709999999999999e-06 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492999+0000", 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6500000000000001e-06 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.299 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507458+0000", 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014459013999999999 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507570+0000", 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011199199999999999 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.508224+0000", 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065380799999999997 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.300 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510045+0000", 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018218609999999999 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513184+0000", 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031387979999999999 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513261+0000", 2024-09-17T16:42:34.301 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:358 3.es0 3:7858efeb:::smithi18337221-46:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7324825150000001, 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020438640000000001, 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.302 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 358 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.303 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493009+0000", 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.304 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493012+0000", 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8150000000000002e-06 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493019+0000", 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3490000000000003e-06 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493024+0000", 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8690000000000003e-06 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.305 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510349+0000", 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017324736 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510406+0000", 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7293000000000002e-05 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510704+0000", 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000298101 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.306 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511712+0000", 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001008227 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513366+0000", 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016533780000000001 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513447+0000", 2024-09-17T16:42:34.307 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1322000000000005e-05 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:359 3.es0 3:7858efeb:::smithi18337221-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7324591360000001, 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021336417999999999, 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.308 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 359 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.309 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.34e-07 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493036+0000", 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8010000000000001e-06 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.310 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493041+0000", 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9910000000000002e-06 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493046+0000", 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8409999999999999e-06 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511258+0000", 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018211793 2024-09-17T16:42:34.311 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511428+0000", 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017049099999999999 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513824+0000", 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002395533 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.312 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513926+0000", 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102079 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.514368+0000", 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044245500000000002 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:360 3.es0 3:78f58299:::smithi18337221-26:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:34.313 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7324381249999998, 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028558304999999999, 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 360 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:34.314 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.46e-07 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.315 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493057+0000", 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9099999999999998e-06 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493062+0000", 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5530000000000003e-06 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493066+0000", 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5719999999999996e-06 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.316 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511762+0000", 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018695494 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511863+0000", 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010166999999999999 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.515440+0000", 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003576419 2024-09-17T16:42:34.317 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517437+0000", 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019973209999999998 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521513+0000", 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040760140000000002 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521611+0000", 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7905999999999994e-05 2024-09-17T16:42:34.318 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:361 3.es0 3:78f58299:::smithi18337221-26:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7324180189999998, 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024151737999999999, 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:34.319 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 361 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.320 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7899999999999999e-07 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493075+0000", 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1090000000000001e-06 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.321 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493082+0000", 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4749999999999998e-06 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493087+0000", 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6829999999999999e-06 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512244+0000", 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019157789000000001 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.322 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512274+0000", 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258e-05 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517080+0000", 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004806495 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:34.323 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517152+0000", 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1958000000000005e-05 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517225+0000", 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2491999999999996e-05 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.324 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWriteReply(3.es0 55/34 ECSubWriteReply(tid=130, last_complete=55'30, committed=1, applied=1))", 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.501544+0000", 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.7239467299999998, 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081050889999999993, 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501544+0000", 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.325 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501544+0000", 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501545+0000", 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3499999999999995e-07 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501549+0000", 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2350000000000001e-06 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.326 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501561+0000", 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2096000000000001e-05 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501568+0000", 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7499999999999997e-06 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509630+0000", 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080621979999999996 2024-09-17T16:42:34.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509649+0000", 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9074999999999999e-05 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s4 60/34 ECSubWrite(tid=52, reqid=osd.15.0:51, at_version=0'0, trim_to=0'0, roll_forward_to=60'32))", 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.515259+0000", 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.71023190199999997, 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079313290000000009, 2024-09-17T16:42:34.328 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515259+0000", 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515259+0000", 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.329 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515260+0000", 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0299999999999998e-07 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515271+0000", 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0898e-05 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515295+0000", 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3859999999999999e-05 2024-09-17T16:42:34.330 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515304+0000", 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2669999999999995e-06 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515560+0000", 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00025637700000000002 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.331 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515571+0000", 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0394000000000001e-05 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523143+0000", 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075727140000000004 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523190+0000", 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7015999999999998e-05 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.332 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s5 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518276+0000", 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.70721443299999998, 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011617036000000001, 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.333 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518276+0000", 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518276+0000", 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518277+0000", 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9700000000000002e-07 2024-09-17T16:42:34.334 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518602+0000", 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032559100000000002 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518624+0000", 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.145e-05 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518631+0000", 2024-09-17T16:42:34.335 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9789999999999996e-06 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518690+0000", 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8721000000000002e-05 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518696+0000", 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7259999999999996e-06 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.336 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529854+0000", 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011157976999999999 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529894+0000", 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9195e-05 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.337 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.339 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:34.340 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:34.337+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:34.440 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:34.438+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:34.442 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.442 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:34.442 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:34.442 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:34.509 INFO:tasks.rados.rados.0.smithi183.stdout:180: done (1 left) 2024-09-17T16:42:34.510 INFO:tasks.rados.rados.0.smithi183.stdout:181: delete oid 45 current snap is 13 2024-09-17T16:42:34.510 INFO:tasks.rados.rados.0.smithi183.stdout:179: expect (ObjNum 48 snap 0 seq_num 48) 2024-09-17T16:42:34.510 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 147622 2024-09-17T16:42:34.519 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:34.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:42:34.531 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:34.539 INFO:tasks.rados.rados.0.smithi183.stdout:179: done (1 left) 2024-09-17T16:42:34.539 INFO:tasks.rados.rados.0.smithi183.stdout:181: done (0 left) 2024-09-17T16:42:34.539 INFO:tasks.rados.rados.0.smithi183.stdout:182: read oid 32 snap -1 2024-09-17T16:42:34.539 INFO:tasks.rados.rados.0.smithi183.stdout:182: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:34.539 INFO:tasks.rados.rados.0.smithi183.stdout:183: snap_remove snap 9 2024-09-17T16:42:34.540 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:34.538+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:34.565 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.565 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:34.565 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:34.565 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:34.566 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.574 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:34.641 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:34.639+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:34.677 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.182268847, 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089069189999999993, 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492597+0000", 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493106+0000", 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050891100000000002 2024-09-17T16:42:34.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493115+0000", 2024-09-17T16:42:34.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8079999999999999e-06 2024-09-17T16:42:34.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493123+0000", 2024-09-17T16:42:34.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8259999999999993e-06 2024-09-17T16:42:34.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493203+0000", 2024-09-17T16:42:34.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0124999999999996e-05 2024-09-17T16:42:34.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493212+0000", 2024-09-17T16:42:34.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8340000000000005e-06 2024-09-17T16:42:34.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501463+0000", 2024-09-17T16:42:34.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082505530000000007 2024-09-17T16:42:34.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501503+0000", 2024-09-17T16:42:34.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9965000000000001e-05 2024-09-17T16:42:34.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.686 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.686 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.686 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:34.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:42:34.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.163244367000001, 2024-09-17T16:42:34.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016927722999999999, 2024-09-17T16:42:34.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.687 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.688 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:42:34.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:42:34.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511621+0000", 2024-09-17T16:42:34.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:42:34.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512062+0000", 2024-09-17T16:42:34.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044157400000000002 2024-09-17T16:42:34.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512083+0000", 2024-09-17T16:42:34.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1058999999999999e-05 2024-09-17T16:42:34.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512094+0000", 2024-09-17T16:42:34.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0559e-05 2024-09-17T16:42:34.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512185+0000", 2024-09-17T16:42:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1187999999999995e-05 2024-09-17T16:42:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512196+0000", 2024-09-17T16:42:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0668e-05 2024-09-17T16:42:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528498+0000", 2024-09-17T16:42:34.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016302408000000001 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528548+0000", 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9808000000000002e-05 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.696 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 46/34 ECSubWrite(tid=63, reqid=client.4553.0:266, at_version=46'34, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:42:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:42:34.697 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.157708677, 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011393616000000001, 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:42:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:42:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517157+0000", 2024-09-17T16:42:34.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4600000000000003e-07 2024-09-17T16:42:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517245+0000", 2024-09-17T16:42:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8442999999999993e-05 2024-09-17T16:42:34.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517258+0000", 2024-09-17T16:42:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2527999999999999e-05 2024-09-17T16:42:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517267+0000", 2024-09-17T16:42:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1230000000000006e-06 2024-09-17T16:42:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517400+0000", 2024-09-17T16:42:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133015 2024-09-17T16:42:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517409+0000", 2024-09-17T16:42:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8980000000000002e-06 2024-09-17T16:42:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528486+0000", 2024-09-17T16:42:34.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011077053999999999 2024-09-17T16:42:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528550+0000", 2024-09-17T16:42:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3708999999999996e-05 2024-09-17T16:42:34.706 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:34.707 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:42:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.154737037, 2024-09-17T16:42:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093715889999999996, 2024-09-17T16:42:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.708 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:42:34.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:42:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520129+0000", 2024-09-17T16:42:34.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0759999999999999e-06 2024-09-17T16:42:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520297+0000", 2024-09-17T16:42:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168049 2024-09-17T16:42:34.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520317+0000", 2024-09-17T16:42:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-09-17T16:42:34.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520326+0000", 2024-09-17T16:42:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6269999999999995e-06 2024-09-17T16:42:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520397+0000", 2024-09-17T16:42:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0418000000000002e-05 2024-09-17T16:42:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520406+0000", 2024-09-17T16:42:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:42:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529445+0000", 2024-09-17T16:42:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090386540000000001 2024-09-17T16:42:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529499+0000", 2024-09-17T16:42:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4462000000000001e-05 2024-09-17T16:42:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 55/34 ECSubWrite(tid=123, reqid=osd.4.0:123, at_version=55'41, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:42:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.487425+0000", 2024-09-17T16:42:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.1874393190000001, 2024-09-17T16:42:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075757740000000004, 2024-09-17T16:42:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.719 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487425+0000", 2024-09-17T16:42:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487425+0000", 2024-09-17T16:42:34.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487426+0000", 2024-09-17T16:42:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5400000000000001e-07 2024-09-17T16:42:34.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487441+0000", 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.488e-05 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487449+0000", 2024-09-17T16:42:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0399999999999993e-06 2024-09-17T16:42:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487454+0000", 2024-09-17T16:42:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0250000000000002e-06 2024-09-17T16:42:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487587+0000", 2024-09-17T16:42:34.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013328600000000001 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487601+0000", 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.394e-05 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494965+0000", 2024-09-17T16:42:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073636470000000001 2024-09-17T16:42:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495001+0000", 2024-09-17T16:42:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6402000000000001e-05 2024-09-17T16:42:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=129, reqid=client.4553.0:353, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:42:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.1846715540000003, 2024-09-17T16:42:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01022205, 2024-09-17T16:42:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490194+0000", 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2330000000000001e-06 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490267+0000", 2024-09-17T16:42:34.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2262999999999996e-05 2024-09-17T16:42:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490279+0000", 2024-09-17T16:42:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2446000000000001e-05 2024-09-17T16:42:34.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490288+0000", 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490363+0000", 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4833999999999995e-05 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490371+0000", 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2640000000000008e-06 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500387+0000", 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010015242000000001 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500415+0000", 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8512000000000001e-05 2024-09-17T16:42:34.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.1816432060000004, 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085314020000000004, 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493222+0000", 2024-09-17T16:42:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8100000000000001e-07 2024-09-17T16:42:34.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493630+0000", 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040793900000000001 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493642+0000", 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1742e-05 2024-09-17T16:42:34.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493655+0000", 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3207000000000001e-05 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493706+0000", 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0887999999999998e-05 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493716+0000", 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3810000000000005e-06 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501720+0000", 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080045050000000003 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501753+0000", 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2858999999999998e-05 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.743 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.1785585559999996, 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010886477, 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496307+0000", 2024-09-17T16:42:34.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496400+0000", 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2985000000000005e-05 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496415+0000", 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4674e-05 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496423+0000", 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2870000000000004e-06 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496478+0000", 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5077999999999997e-05 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496488+0000", 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-09-17T16:42:34.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507159+0000", 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010670513 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507193+0000", 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3884999999999998e-05 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 56/34 ECSubWrite(tid=107, reqid=client.4553.0:402, at_version=56'12, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:29.501301+0000", 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.1735635550000003, 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074580710000000001, 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501301+0000", 2024-09-17T16:42:34.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501301+0000", 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501302+0000", 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4499999999999996e-07 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501511+0000", 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000208748 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501522+0000", 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1253999999999999e-05 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501528+0000", 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.195e-06 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501594+0000", 2024-09-17T16:42:34.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5395999999999995e-05 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.501600+0000", 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8530000000000003e-06 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.508723+0000", 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071221690000000002 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.508759+0000", 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6610999999999999e-05 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.172711863, 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010661874999999999, 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.754 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502154+0000", 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1999999999999998e-07 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502368+0000", 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000213904 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502383+0000", 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5447999999999998e-05 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502395+0000", 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1589e-05 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502457+0000", 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2644000000000005e-05 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502467+0000", 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0206e-05 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512759+0000", 2024-09-17T16:42:34.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010291234999999999 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512815+0000", 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6029000000000002e-05 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.759 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=129, reqid=osd.5.0:129, at_version=60'87, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.504191+0000", 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.170673501, 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078014139999999996, 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504191+0000", 2024-09-17T16:42:34.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504191+0000", 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504192+0000", 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504263+0000", 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0758000000000003e-05 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504310+0000", 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7613e-05 2024-09-17T16:42:34.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504335+0000", 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4133000000000001e-05 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504947+0000", 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061235 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504958+0000", 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0821e-05 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.511913+0000", 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069554090000000001 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.511993+0000", 2024-09-17T16:42:34.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9499999999999994e-05 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s6 60/34 ECSubWrite(tid=26, reqid=osd.11.0:26, at_version=60'21, trim_to=0'0, roll_forward_to=59'19))", 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.504256+0000", 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1706087430000001, 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076432619999999996, 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.765 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504256+0000", 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504256+0000", 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504257+0000", 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7000000000000004e-07 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504312+0000", 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5683000000000002e-05 2024-09-17T16:42:34.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504342+0000", 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9586000000000001e-05 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504381+0000", 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9263e-05 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504534+0000", 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00015275299999999999 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504547+0000", 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3412e-05 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.511841+0000", 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072937619999999996 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.511899+0000", 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8133000000000001e-05 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 60/34 ECSubWrite(tid=130, reqid=osd.5.0:130, at_version=60'19, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1704556779999999, 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082366980000000006, 2024-09-17T16:42:34.770 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504410+0000", 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-06 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504450+0000", 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9808999999999998e-05 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504480+0000", 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0326000000000001e-05 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504488+0000", 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.96e-06 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504566+0000", 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8146999999999996e-05 2024-09-17T16:42:34.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504577+0000", 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0468999999999999e-05 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512615+0000", 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080376030000000008 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512646+0000", 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1198000000000002e-05 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 60/34 ECSubWrite(tid=50, reqid=osd.13.0:50, at_version=60'21, trim_to=0'0, roll_forward_to=59'19))", 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.505022+0000", 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.169842834, 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073638469999999998, 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.775 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505022+0000", 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505022+0000", 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505022+0000", 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4799999999999999e-07 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505049+0000", 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6707e-05 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505063+0000", 2024-09-17T16:42:34.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.362e-05 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505072+0000", 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4620000000000002e-06 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505149+0000", 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6760000000000004e-05 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505160+0000", 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.08e-05 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512343+0000", 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071832090000000003 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512386+0000", 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2941000000000001e-05 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.779 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=131, reqid=osd.5.0:131, at_version=60'89, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1696626459999999, 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012770672, 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505203+0000", 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.017e-06 2024-09-17T16:42:34.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505226+0000", 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3224e-05 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505239+0000", 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505248+0000", 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9549999999999998e-06 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507065+0000", 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018174560000000001 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507074+0000", 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6589999999999996e-06 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517937+0000", 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010863268000000001 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517973+0000", 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5349000000000003e-05 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 60/34 ECSubWrite(tid=132, reqid=client.4553.0:429, at_version=60'21, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.168761594, 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084385769999999992, 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506104+0000", 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506142+0000", 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7592000000000002e-05 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506156+0000", 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4269e-05 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506165+0000", 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9279999999999999e-06 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506988+0000", 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00082270100000000001 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506998+0000", 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0118e-05 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514501+0000", 2024-09-17T16:42:34.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075035309999999999 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514542+0000", 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0519999999999998e-05 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 60/34 ECSubWrite(tid=145, reqid=osd.4.0:145, at_version=60'33, trim_to=0'0, roll_forward_to=59'31))", 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:42:34.789 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.165516309, 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083206809999999999, 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509349+0000", 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6100000000000002e-07 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509370+0000", 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1115e-05 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509381+0000", 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1476e-05 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509390+0000", 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509447+0000", 2024-09-17T16:42:34.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6520000000000001e-05 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509457+0000", 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6889999999999999e-06 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517639+0000", 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081822079999999998 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517669+0000", 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0182999999999999e-05 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 60/34 ECSubWrite(tid=144, reqid=osd.2.0:144, at_version=60'45, trim_to=0'0, roll_forward_to=59'43))", 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513025+0000", 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.161839649, 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073316140000000002, 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.794 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513025+0000", 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513025+0000", 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513025+0000", 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7e-07 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513059+0000", 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3451999999999998e-05 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513071+0000", 2024-09-17T16:42:34.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2364000000000001e-05 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513080+0000", 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3999999999999992e-06 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513163+0000", 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3615999999999994e-05 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513174+0000", 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0548e-05 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.520310+0000", 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071359270000000002 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.520357+0000", 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6937000000000001e-05 2024-09-17T16:42:34.798 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 60/34 ECSubWrite(tid=145, reqid=osd.2.0:145, at_version=60'47, trim_to=0'0, roll_forward_to=59'43))", 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.161119169, 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01010516, 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.92e-07 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513775+0000", 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8588000000000001e-05 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513792+0000", 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6854000000000002e-05 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.801 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513806+0000", 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4683e-05 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515751+0000", 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001944814 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515778+0000", 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7189999999999999e-05 2024-09-17T16:42:34.802 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523825+0000", 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080462659999999998 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523851+0000", 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5973e-05 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.803 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=138, reqid=client.4553.0:432, at_version=60'91, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.1608767639999999, 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099123409999999999, 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:34.804 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513989+0000", 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.82e-07 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.805 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514171+0000", 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018223600000000001 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514183+0000", 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2313999999999999e-05 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514192+0000", 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1849999999999993e-06 2024-09-17T16:42:34.806 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514282+0000", 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0068999999999994e-05 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514294+0000", 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.203e-05 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523860+0000", 2024-09-17T16:42:34.807 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095660139999999994 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523900+0000", 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9910999999999998e-05 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:34.808 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.810 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:34.808+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:34.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:34.911 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:34.909+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:34.913 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:34.913 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:34.914 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:34.914 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:34.922 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:34.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:35.024 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:35.024 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:35.024 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:35.024 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:35.024 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:35.025 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:35.023+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:35.033 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:35.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:35.112 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:35.110+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:35.125 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:35.125 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.641726452, 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067612239999999997, 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492656+0000", 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492657+0000", 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.066e-06 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493093+0000", 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043573899999999998 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493113+0000", 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9661999999999999e-05 2024-09-17T16:42:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493126+0000", 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2778e-05 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493222+0000", 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6797000000000002e-05 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493232+0000", 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0042e-05 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499374+0000", 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061420320000000004 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499418+0000", 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3108000000000001e-05 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.141 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.622779594000001, 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013863510000000001, 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:35.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513354+0000", 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001750883 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513367+0000", 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3108999999999999e-05 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513376+0000", 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8969999999999997e-06 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513451+0000", 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513461+0000", 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0023999999999999e-05 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525431+0000", 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011969377 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525467+0000", 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5988000000000002e-05 2024-09-17T16:42:35.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.614431711, 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083605350000000005, 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9800000000000002e-07 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520423+0000", 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047090499999999998 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520443+0000", 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0477000000000001e-05 2024-09-17T16:42:35.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520453+0000", 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520913+0000", 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045979899999999999 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520921+0000", 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3010000000000007e-06 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528270+0000", 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073484370000000002 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2073999999999997e-05 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.151 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.611712943000001, 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089774009999999994, 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:35.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999999e-07 2024-09-17T16:42:35.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523392+0000", 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072203800000000004 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523434+0000", 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1365000000000001e-05 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523451+0000", 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7119e-05 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523565+0000", 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011433 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523577+0000", 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1697e-05 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531599+0000", 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080225629999999999 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531647+0000", 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7960000000000002e-05 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 11.649227714, 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080533949999999997, 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485155+0000", 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8700000000000002e-07 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485843+0000", 2024-09-17T16:42:35.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068809999999999997 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485856+0000", 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2561000000000001e-05 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485863+0000", 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485940+0000", 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6754000000000004e-05 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.485952+0000", 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2438e-05 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.493183+0000", 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072314069999999996 2024-09-17T16:42:35.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.493208+0000", 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5083e-05 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 55/34 ECSubWrite(tid=56, reqid=osd.14.0:56, at_version=55'27, trim_to=0'0, roll_forward_to=53'25))", 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.484106+0000", 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6502769659999998, 2024-09-17T16:42:35.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076561550000000004, 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484106+0000", 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484106+0000", 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484106+0000", 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8000000000000001e-07 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484127+0000", 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1212e-05 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484136+0000", 2024-09-17T16:42:35.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9160000000000007e-06 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484145+0000", 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3780000000000001e-06 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484222+0000", 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7052999999999996e-05 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484247+0000", 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5400000000000001e-05 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.491725+0000", 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0074773649999999997 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.491762+0000", 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7450999999999998e-05 2024-09-17T16:42:35.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 55/34 ECSubWrite(tid=120, reqid=osd.4.0:117, at_version=0'0, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.484690+0000", 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6496926040000002, 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071036329999999998, 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484690+0000", 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484690+0000", 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484691+0000", 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1999999999999999e-07 2024-09-17T16:42:35.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484700+0000", 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4970000000000007e-06 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484714+0000", 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3134e-05 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484722+0000", 2024-09-17T16:42:35.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9950000000000005e-06 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484773+0000", 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1857999999999997e-05 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484785+0000", 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1276e-05 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.491767+0000", 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069818720000000001 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.491794+0000", 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7280999999999999e-05 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=93, reqid=osd.5.0:93, at_version=55'60, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6493823800000005, 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099079770000000001, 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485001+0000", 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485013+0000", 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2393e-05 2024-09-17T16:42:35.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485021+0000", 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9230000000000002e-06 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485026+0000", 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0980000000000001e-06 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485078+0000", 2024-09-17T16:42:35.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1650999999999997e-05 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485087+0000", 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9039999999999998e-06 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494869+0000", 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097825159999999998 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494908+0000", 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.909e-05 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 55/34 ECSubWrite(tid=60, reqid=osd.14.0:60, at_version=55'29, trim_to=0'0, roll_forward_to=53'25))", 2024-09-17T16:42:35.178 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6489062820000004, 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091203440000000007, 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-17T16:42:35.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485497+0000", 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0041e-05 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485509+0000", 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1668000000000001e-05 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485517+0000", 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.841e-06 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485572+0000", 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325999999999998e-05 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485582+0000", 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105000000000001e-05 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494561+0000", 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089786810000000005 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494597+0000", 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6019000000000002e-05 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.183 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6478061999999998, 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018742894999999999, 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486599+0000", 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1361000000000001e-05 2024-09-17T16:42:35.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486608+0000", 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486616+0000", 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.537e-06 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486743+0000", 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127188 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486748+0000", 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4489999999999998e-06 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505277+0000", 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018528340000000001 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505320+0000", 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2834999999999999e-05 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=122, reqid=osd.4.0:119, at_version=0'0, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6472976680000002, 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013009134, 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.188 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487086+0000", 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5099999999999999e-07 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487097+0000", 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487113+0000", 2024-09-17T16:42:35.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5336e-05 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487121+0000", 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487184+0000", 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3207999999999995e-05 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487195+0000", 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1467999999999999e-05 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499908+0000", 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012713089 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500094+0000", 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000185847 2024-09-17T16:42:35.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 55/34 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=55'24, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6444725409999998, 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010075503, 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1899999999999999e-07 2024-09-17T16:42:35.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489931+0000", 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-05 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489946+0000", 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5729000000000001e-05 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489954+0000", 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2549999999999997e-06 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490014+0000", 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9242e-05 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490024+0000", 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.004e-05 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499913+0000", 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098893910000000008 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499986+0000", 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2607000000000005e-05 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.197 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6410297209999998, 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090505629999999993, 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493354+0000", 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7199999999999997e-07 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493765+0000", 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041148500000000001 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493776+0000", 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1021e-05 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493784+0000", 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5569999999999998e-06 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:42:35.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5838999999999999e-05 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493836+0000", 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.993e-06 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502370+0000", 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085342400000000002 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502404+0000", 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3556000000000002e-05 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.6354995089999997, 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011728341, 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.202 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498884+0000", 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6400000000000001e-07 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499236+0000", 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035160500000000001 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499249+0000", 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3454e-05 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499256+0000", 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.905e-06 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499318+0000", 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2067000000000001e-05 2024-09-17T16:42:35.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499329+0000", 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1131000000000001e-05 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510579+0000", 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011250135 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510612+0000", 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2280000000000003e-05 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.5274856110000004, 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089676530000000008, 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.207 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606898+0000", 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9699999999999995e-07 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607272+0000", 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037431900000000002 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607286+0000", 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.328e-05 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607294+0000", 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8179999999999993e-06 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607356+0000", 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1290000000000004e-05 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607366+0000", 2024-09-17T16:42:35.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8949999999999993e-06 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.615839+0000", 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084733959999999994 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.615865+0000", 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5857999999999999e-05 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:29.502322+0000", 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.6320611750000005, 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068919940000000002, 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502322+0000", 2024-09-17T16:42:35.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502322+0000", 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502322+0000", 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9700000000000002e-07 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502966+0000", 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00064395100000000003 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502979+0000", 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3002e-05 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502990+0000", 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1496e-05 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.503069+0000", 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8799000000000002e-05 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.503077+0000", 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7719999999999994e-06 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.509176+0000", 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006098511 2024-09-17T16:42:35.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.509214+0000", 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8065999999999998e-05 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 60/34 ECSubWrite(tid=131, reqid=osd.5.0:131, at_version=60'89, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.505415+0000", 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.628967987, 2024-09-17T16:42:35.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0068877829999999998, 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505415+0000", 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505415+0000", 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505415+0000", 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3099999999999998e-07 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505437+0000", 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2124999999999999e-05 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.218 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505449+0000", 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1249e-05 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505462+0000", 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2794e-05 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506024+0000", 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00056287799999999995 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.219 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506035+0000", 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0550000000000001e-05 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512269+0000", 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062345200000000003 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512303+0000", 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3136000000000003e-05 2024-09-17T16:42:35.220 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 60/34 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=60'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513555+0000", 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.620827349, 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069014840000000003, 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.221 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513555+0000", 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513555+0000", 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513556+0000", 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3799999999999996e-07 2024-09-17T16:42:35.222 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513578+0000", 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1260999999999999e-05 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513592+0000", 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4679e-05 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513598+0000", 2024-09-17T16:42:35.223 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2559999999999999e-06 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513653+0000", 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4218000000000002e-05 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513663+0000", 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0273e-05 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.224 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.520406+0000", 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006742619 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.520457+0000", 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.134e-05 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:35.225 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.6158105520000001, 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011339162, 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.226 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518573+0000", 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518909+0000", 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033576100000000001 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.227 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518925+0000", 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5661000000000001e-05 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518933+0000", 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4209999999999995e-06 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519013+0000", 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0346000000000006e-05 2024-09-17T16:42:35.228 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519023+0000", 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0212e-05 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529853+0000", 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010829221 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.229 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529911+0000", 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8709999999999999e-05 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.526345+0000", 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.608037969, 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0076519320000000002, 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:35.230 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526345+0000", 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526345+0000", 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526346+0000", 2024-09-17T16:42:35.231 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2800000000000005e-07 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526545+0000", 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00019919600000000001 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526561+0000", 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.628e-05 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.232 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526570+0000", 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6289999999999999e-06 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526670+0000", 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9852000000000006e-05 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.526680+0000", 2024-09-17T16:42:35.233 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0013999999999999e-05 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.533958+0000", 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072783730000000003 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.533997+0000", 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8659999999999999e-05 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.234 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:35.235 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:35.235 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:35.236 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:35.236 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:35.237 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:35.237 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:35.237 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:35.238 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:35.238 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:35.239 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:35.239 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:35.239 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:35.234+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:35.337 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:35.334+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:35.342 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:35.342 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:35.342 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:35.350 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:35.410 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:35.411 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:35.428 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:35.428 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:35.435 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:42:35.436 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:35.434+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:35.442 INFO:tasks.rados.rados.0.smithi183.stdout:183: done (1 left) 2024-09-17T16:42:35.442 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 14 current snap is 13 2024-09-17T16:42:35.442 INFO:tasks.rados.rados.0.smithi183.stdout:184: seq_num 86 ranges {0=688128,688128=540672,1228800=229376} 2024-09-17T16:42:35.446 INFO:tasks.rados.rados.0.smithi183.stdout:184: writing smithi18337221-14 from 0 to 688128 tid 1 2024-09-17T16:42:35.448 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:35.448 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:35.450 INFO:tasks.rados.rados.0.smithi183.stdout:184: writing smithi18337221-14 from 688128 to 1228800 tid 2 2024-09-17T16:42:35.452 INFO:tasks.rados.rados.0.smithi183.stdout:184: writing smithi18337221-14 from 1228800 to 1458176 tid 3 2024-09-17T16:42:35.452 INFO:tasks.rados.rados.0.smithi183.stdout:185: snap_remove snap 12 2024-09-17T16:42:35.466 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:35.467 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:35.467 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:35.477 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:35.479 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:35.480 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:35.496 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:35.497 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:35.515 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:35.515 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:35.531 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:35.532 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:35.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:35.531+0000 7f602a431640 0 -- 172.21.15.60:0/994906873 >> [v2:172.21.15.98:6816/2084737149,v1:172.21.15.98:6817/2084737149] conn(0x7f602421c470 msgr2=0x7f602421e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:35.549 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:35.550 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:35.561 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:35.559+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:35.566 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:35.566 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:35.583 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:35.584 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:35.599 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:35.599 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:35.600 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T16:42:35.600 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T16:42:35.619 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:35.619 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:35.628 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:35.673 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:35.671+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:35.740 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:35.738+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:35.740 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:35.740 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:35.749 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:35.841 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:35.838+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:35.891 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:35.892 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:35.901 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:35.936 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:35.936 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 62, 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "a18a1a02-ea8d-4573-a275-cb30a154e84c", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-17T16:41:30.645147+0000", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-17T16:42:35.433398+0000", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2024-09-17T16:41:45.664856+0000", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2024-09-17T16:41:34.797369+0000", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5804032, 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "nodeep-scrub", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2024-09-17T16:42:35.937 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 7, 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 3, 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 16, 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2024-09-17T16:42:35.938 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "squid", 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_crimson": false, 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2024-09-17T16:41:43.059025+0000", 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2024-09-17T16:42:35.939 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "is_stretch_pool": false, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2024-09-17T16:42:35.940 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "25", 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T16:42:35.941 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2024-09-17T16:42:35.942 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2024-09-17T16:42:35.943 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2024-09-17T16:42:35.944 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "read_balance": { 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "score_type": "Fair distribution", 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "score_acting": 15.380000114440918, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "score_stable": 15.380000114440918, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_acting": 2, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_stable": 2, 2024-09-17T16:42:35.945 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity_weighted": 1, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity": 1, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity_weighted": 1 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2024-09-17T16:41:53.164635+0000", 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 8193, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2024-09-17T16:42:35.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "is_stretch_pool": false, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2024-09-17T16:42:35.947 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "30", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2024-09-17T16:42:35.948 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 2, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 30, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2024-09-17T16:42:35.949 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2024-09-17T16:42:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "read_balance": { 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "score_type": "Fair distribution", 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "score_acting": 3.9900000095367432, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "score_stable": 3.9900000095367432, 2024-09-17T16:42:35.951 INFO:teuthology.orchestra.run.smithi060.stdout: "optimal_score": 0.68999999761581421, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_acting": 2.75, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_stable": 2.75, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity_weighted": 1, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity": 1, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity_weighted": 1 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "unique_pool_0", 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2024-09-17T16:42:06.437635+0000", 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 8193, 2024-09-17T16:42:35.952 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 3, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 7, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 5, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 1, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "is_stretch_pool": false, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 16, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 16, 2024-09-17T16:42:35.953 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 16, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 16, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 16, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "62", 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2024-09-17T16:42:35.954 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 14, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 62, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2024-09-17T16:42:35.955 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "shecprofile", 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2024-09-17T16:42:35.956 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 16384, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: "rados": {} 2024-09-17T16:42:35.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "c580007f-04f5-4607-bcb0-9eca9fb6a273", 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.958 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2024-09-17T16:42:35.959 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.960 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6817/360852295", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6819/360852295", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6823/360852295", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6821/360852295", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:35.963 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "5068e4a5-399f-472d-bf4d-0105adfba800", 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:35.964 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6824", 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6825", 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6826", 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6827", 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6830", 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6831", 2024-09-17T16:42:35.967 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6828", 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6829", 2024-09-17T16:42:35.968 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6825/2001248690", 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6827/2001248690", 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6831/2001248690", 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6829/2001248690", 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d", 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.970 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6808", 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6809", 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.971 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6810", 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6811", 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6814", 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6815", 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.973 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6812", 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6813", 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6809/1107977430", 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6811/1107977430", 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6815/1107977430", 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6813/1107977430", 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2024-09-17T16:42:35.975 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "e00f6dc3-b74d-441a-abff-55ed4fba87a1", 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6826", 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6827", 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6828", 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6829", 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6832", 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6833", 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.979 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6830", 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6831", 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6827/3360497893", 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6829/3360497893", 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6833/3360497893", 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6831/3360497893", 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "7d0041d5-389e-4b11-b8e1-535c6113a4f7", 2024-09-17T16:42:35.981 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.982 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.983 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.984 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6825/3686363495", 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/3686363495", 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/3686363495", 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/3686363495", 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2024-09-17T16:42:35.988 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "9fc5ba03-7465-43f6-a148-fcecb32304a7", 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 23, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.989 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6800", 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6801", 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6802", 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6803", 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6806", 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6807", 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6804", 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6805", 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6801/3943188618", 2024-09-17T16:42:35.993 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6803/3943188618", 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3943188618", 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3943188618", 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f2be94b-f485-485b-9d16-80f293b0274c", 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:35.994 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 27, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6800", 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6801", 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6802", 2024-09-17T16:42:35.996 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6803", 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6806", 2024-09-17T16:42:35.997 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6807", 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6804", 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6805", 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6801/2604225407", 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6803/2604225407", 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6807/2604225407", 2024-09-17T16:42:35.999 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6805/2604225407", 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eedf3336-c9e3-4c8c-b81a-2f0ebfad326c", 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.000 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6818", 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6819", 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6820", 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6821", 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6824", 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6825", 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6822", 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6823", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6819/462795917", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6821/462795917", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6825/462795917", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6823/462795917", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.005 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 8, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "44e1f674-128a-4388-a488-ffdec5ab479a", 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 21, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:36.006 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.007 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2024-09-17T16:42:36.008 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2024-09-17T16:42:36.009 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2024-09-17T16:42:36.010 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/680830956", 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/680830956", 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/680830956", 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/680830956", 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 9, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "c085e6d8-5929-4ab1-826e-cecb51ed73cd", 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 21, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 27, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.012 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6808", 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6809", 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.013 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6810", 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6811", 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.014 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6814", 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6815", 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6812", 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6813", 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6809/2482839491", 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6811/2482839491", 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6815/2482839491", 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6813/2482839491", 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 10, 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "87248b6a-e219-48a5-911c-4995588e51a2", 2024-09-17T16:42:36.017 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.018 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6816", 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6817", 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.019 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6818", 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6819", 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6822", 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6823", 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6820", 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6821", 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6817/598689172", 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6819/598689172", 2024-09-17T16:42:36.022 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6823/598689172", 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6821/598689172", 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 11, 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "21b3d129-c96b-4240-aaaf-682d06b10e50", 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.023 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6802", 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6803", 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6804", 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6805", 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6808", 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6809", 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6806", 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6807", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6803/2000091361", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6805/2000091361", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6809/2000091361", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6807/2000091361", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.028 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 12, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "953f99d2-c3d1-4bac-b9c7-7f56bed3a05f", 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:36.029 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2024-09-17T16:42:36.030 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6809/1039497225", 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6811/1039497225", 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6815/1039497225", 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6813/1039497225", 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.034 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 13, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "a4d32ef9-7344-4d6e-a16c-8cc8623b23a6", 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.035 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6816", 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6817", 2024-09-17T16:42:36.036 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6818", 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.037 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6819", 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6822", 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.038 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6823", 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6820", 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.039 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6821", 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6817/2084737149", 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6819/2084737149", 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6823/2084737149", 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6821/2084737149", 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.040 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 14, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "9305c16f-a01d-4eb1-95ff-df3616720e1f", 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:36.041 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6824", 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6825", 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.042 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6826", 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6827", 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.043 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6830", 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6831", 2024-09-17T16:42:36.044 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6828", 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6829", 2024-09-17T16:42:36.045 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6825/3233790125", 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6827/3233790125", 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6831/3233790125", 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6829/3233790125", 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.046 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 15, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "9a0ea790-a644-426d-baa7-35a2699a2123", 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6810", 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6811", 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:36.048 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6812", 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6813", 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:36.049 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6816", 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6817", 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.050 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6814", 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6815", 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.051 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6811/2101706733", 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6813/2101706733", 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6817/2101706733", 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6815/2101706733", 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2024-09-17T16:42:36.052 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.116010+0000", 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.053 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.262806+0000", 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.286245+0000", 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.503712+0000", 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2024-09-17T16:42:36.055 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.012231+0000", 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.056 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.640379+0000", 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.883245+0000", 2024-09-17T16:42:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.851004+0000", 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 8, 2024-09-17T16:42:36.058 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.608180+0000", 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 9, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.059 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.570621+0000", 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 10, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.142430+0000", 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 11, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.173864+0000", 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 12, 2024-09-17T16:42:36.061 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.076485+0000", 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 13, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.062 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.038949+0000", 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 14, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.842812+0000", 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 15, 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.328280+0000", 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_primaries": [], 2024-09-17T16:42:36.064 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "shecprofile": { 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "c": "2", 2024-09-17T16:42:36.065 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-device-class": "", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-num-failure-domains": "0", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-root": "default", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "4", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "3", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "shecprofile", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "shec", 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "multiple" 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [ 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.066 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: "snaps": [ 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 8, 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 2 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 11, 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 3 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:36.067 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [ 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "snaps": [ 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 11, 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 1 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [ 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2024-09-17T16:42:36.068 INFO:teuthology.orchestra.run.smithi060.stdout: "snaps": [ 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 6, 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 2 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 10, 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 1 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2024-09-17T16:42:36.069 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:36.070 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:36.072 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.072 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.073 INFO:tasks.thrashosds.thrasher:j is {'epoch': 62, 'fsid': 'a18a1a02-ea8d-4573-a275-cb30a154e84c', 'created': '2024-09-17T16:41:30.645147+0000', 'modified': '2024-09-17T16:42:35.433398+0000', 'last_up_change': '2024-09-17T16:41:45.664856+0000', 'last_in_change': '2024-09-17T16:41:34.797369+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 16, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T16:41:43.059025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 15.380000114440918, 'score_stable': 15.380000114440918, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T16:41:53.164635+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 30, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.990000009536743, 'score_stable': 3.990000009536743, 'optimal_score': 0.6899999976158142, 'raw_score_acting': 2.75, 'raw_score_stable': 2.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-17T16:42:06.437635+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 3, 'size': 7, 'min_size': 5, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 14, 'snap_epoch': 62, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'shecprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 16384, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'c580007f-04f5-4607-bcb0-9eca9fb6a273', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6816', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6817', 'nonce': 360852295}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6818', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6819', 'nonce': 360852295}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6822', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6823', 'nonce': 360852295}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6820', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6821', 'nonce': 360852295}]}, 'public_addr': '172.21.15.60:6817/360852295', 'cluster_addr': '172.21.15.60:6819/360852295', 'heartbeat_back_addr': '172.21.15.60:6823/360852295', 'heartbeat_front_addr': '172.21.15.60:6821/360852295', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '5068e4a5-399f-472d-bf4d-0105adfba800', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6824', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6825', 'nonce': 2001248690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6826', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6827', 'nonce': 2001248690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6830', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6831', 'nonce': 2001248690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6828', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6829', 'nonce': 2001248690}]}, 'public_addr': '172.21.15.98:6825/2001248690', 'cluster_addr': '172.21.15.98:6827/2001248690', 'heartbeat_back_addr': '172.21.15.98:6831/2001248690', 'heartbeat_front_addr': '172.21.15.98:6829/2001248690', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6808', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6809', 'nonce': 1107977430}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6810', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6811', 'nonce': 1107977430}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6814', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6815', 'nonce': 1107977430}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6812', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6813', 'nonce': 1107977430}]}, 'public_addr': '172.21.15.111:6809/1107977430', 'cluster_addr': '172.21.15.111:6811/1107977430', 'heartbeat_back_addr': '172.21.15.111:6815/1107977430', 'heartbeat_front_addr': '172.21.15.111:6813/1107977430', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e00f6dc3-b74d-441a-abff-55ed4fba87a1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6826', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6827', 'nonce': 3360497893}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6828', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6829', 'nonce': 3360497893}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6833', 'nonce': 3360497893}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6830', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6831', 'nonce': 3360497893}]}, 'public_addr': '172.21.15.183:6827/3360497893', 'cluster_addr': '172.21.15.183:6829/3360497893', 'heartbeat_back_addr': '172.21.15.183:6833/3360497893', 'heartbeat_front_addr': '172.21.15.183:6831/3360497893', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7d0041d5-389e-4b11-b8e1-535c6113a4f7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6824', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6825', 'nonce': 3686363495}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6826', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6827', 'nonce': 3686363495}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6830', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6831', 'nonce': 3686363495}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6828', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6829', 'nonce': 3686363495}]}, 'public_addr': '172.21.15.60:6825/3686363495', 'cluster_addr': '172.21.15.60:6827/3686363495', 'heartbeat_back_addr': '172.21.15.60:6831/3686363495', 'heartbeat_front_addr': '172.21.15.60:6829/3686363495', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '9fc5ba03-7465-43f6-a148-fcecb32304a7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3943188618}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3943188618}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3943188618}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3943188618}]}, 'public_addr': '172.21.15.98:6801/3943188618', 'cluster_addr': '172.21.15.98:6803/3943188618', 'heartbeat_back_addr': '172.21.15.98:6807/3943188618', 'heartbeat_front_addr': '172.21.15.98:6805/3943188618', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2f2be94b-f485-485b-9d16-80f293b0274c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 2604225407}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 2604225407}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 2604225407}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 2604225407}]}, 'public_addr': '172.21.15.111:6801/2604225407', 'cluster_addr': '172.21.15.111:6803/2604225407', 'heartbeat_back_addr': '172.21.15.111:6807/2604225407', 'heartbeat_front_addr': '172.21.15.111:6805/2604225407', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'eedf3336-c9e3-4c8c-b81a-2f0ebfad326c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6818', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6819', 'nonce': 462795917}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6820', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6821', 'nonce': 462795917}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6824', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6825', 'nonce': 462795917}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6822', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6823', 'nonce': 462795917}]}, 'public_addr': '172.21.15.183:6819/462795917', 'cluster_addr': '172.21.15.183:6821/462795917', 'heartbeat_back_addr': '172.21.15.183:6825/462795917', 'heartbeat_front_addr': '172.21.15.183:6823/462795917', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': '44e1f674-128a-4388-a488-ffdec5ab479a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6800', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6801', 'nonce': 680830956}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6802', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6803', 'nonce': 680830956}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6806', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6807', 'nonce': 680830956}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6804', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6805', 'nonce': 680830956}]}, 'public_addr': '172.21.15.60:6801/680830956', 'cluster_addr': '172.21.15.60:6803/680830956', 'heartbeat_back_addr': '172.21.15.60:6807/680830956', 'heartbeat_front_addr': '172.21.15.60:6805/680830956', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': 'c085e6d8-5929-4ab1-826e-cecb51ed73cd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6808', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6809', 'nonce': 2482839491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6810', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6811', 'nonce': 2482839491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6814', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6815', 'nonce': 2482839491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6812', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6813', 'nonce': 2482839491}]}, 'public_addr': '172.21.15.98:6809/2482839491', 'cluster_addr': '172.21.15.98:6811/2482839491', 'heartbeat_back_addr': '172.21.15.98:6815/2482839491', 'heartbeat_front_addr': '172.21.15.98:6813/2482839491', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': '87248b6a-e219-48a5-911c-4995588e51a2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6816', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6817', 'nonce': 598689172}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6818', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 598689172}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6822', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6823', 'nonce': 598689172}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6820', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6821', 'nonce': 598689172}]}, 'public_addr': '172.21.15.111:6817/598689172', 'cluster_addr': '172.21.15.111:6819/598689172', 'heartbeat_back_addr': '172.21.15.111:6823/598689172', 'heartbeat_front_addr': '172.21.15.111:6821/598689172', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': '21b3d129-c96b-4240-aaaf-682d06b10e50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6802', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6803', 'nonce': 2000091361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6804', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6805', 'nonce': 2000091361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6808', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6809', 'nonce': 2000091361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6806', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6807', 'nonce': 2000091361}]}, 'public_addr': '172.21.15.183:6803/2000091361', 'cluster_addr': '172.21.15.183:6805/2000091361', 'heartbeat_back_addr': '172.21.15.183:6809/2000091361', 'heartbeat_front_addr': '172.21.15.183:6807/2000091361', 'state': ['exists', 'up']}, {'osd': 12, 'uuid': '953f99d2-c3d1-4bac-b9c7-7f56bed3a05f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6808', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6809', 'nonce': 1039497225}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6810', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6811', 'nonce': 1039497225}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6814', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6815', 'nonce': 1039497225}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6812', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6813', 'nonce': 1039497225}]}, 'public_addr': '172.21.15.60:6809/1039497225', 'cluster_addr': '172.21.15.60:6811/1039497225', 'heartbeat_back_addr': '172.21.15.60:6815/1039497225', 'heartbeat_front_addr': '172.21.15.60:6813/1039497225', 'state': ['exists', 'up']}, {'osd': 13, 'uuid': 'a4d32ef9-7344-4d6e-a16c-8cc8623b23a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6816', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6817', 'nonce': 2084737149}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6818', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6819', 'nonce': 2084737149}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6822', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6823', 'nonce': 2084737149}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6820', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6821', 'nonce': 2084737149}]}, 'public_addr': '172.21.15.98:6817/2084737149', 'cluster_addr': '172.21.15.98:6819/2084737149', 'heartbeat_back_addr': '172.21.15.98:6823/2084737149', 'heartbeat_front_addr': '172.21.15.98:6821/2084737149', 'state': ['exists', 'up']}, {'osd': 14, 'uuid': '9305c16f-a01d-4eb1-95ff-df3616720e1f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6824', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6825', 'nonce': 3233790125}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6826', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6827', 'nonce': 3233790125}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6830', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6831', 'nonce': 3233790125}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6828', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6829', 'nonce': 3233790125}]}, 'public_addr': '172.21.15.111:6825/3233790125', 'cluster_addr': '172.21.15.111:6827/3233790125', 'heartbeat_back_addr': '172.21.15.111:6831/3233790125', 'heartbeat_front_addr': '172.21.15.111:6829/3233790125', 'state': ['exists', 'up']}, {'osd': 15, 'uuid': '9a0ea790-a644-426d-baa7-35a2699a2123', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6810', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6811', 'nonce': 2101706733}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6812', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6813', 'nonce': 2101706733}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6816', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6817', 'nonce': 2101706733}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6814', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6815', 'nonce': 2101706733}]}, 'public_addr': '172.21.15.183:6811/2101706733', 'cluster_addr': '172.21.15.183:6813/2101706733', 'heartbeat_back_addr': '172.21.15.183:6817/2101706733', 'heartbeat_front_addr': '172.21.15.183:6815/2101706733', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.116010+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.262806+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.286245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.503712+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.012231+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.640379+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.883245+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.851004+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.608180+0000', 'dead_epoch': 0}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.570621+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.142430+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.173864+0000', 'dead_epoch': 0}, {'osd': 12, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.076485+0000', 'dead_epoch': 0}, {'osd': 13, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.038949+0000', 'dead_epoch': 0}, {'osd': 14, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.842812+0000', 'dead_epoch': 0}, {'osd': 15, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.328280+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}, 'shecprofile': {'c': '2', 'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'k': '4', 'm': '3', 'name': 'shecprofile', 'plugin': 'shec', 'technique': 'multiple'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 8, 'length': 2}, {'begin': 11, 'length': 3}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 6, 'length': 2}, {'begin': 10, 'length': 1}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T16:42:36.074 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:36.074 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:36.075 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:36.069+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:36.173 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:36.171+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:36.215 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.216 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.224 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:36.275 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:36.273+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:36.326 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.326 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.335 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:36.373 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:36.373 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:36.375 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:36.373+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:36.386 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-17T16:42:35.435915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":50119219,"num_objects":86,"num_object_clones":32,"num_object_copies":582,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":7,"num_read":318,"num_read_kb":38667,"num_write":435,"num_write_kb":54584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":539948,"kb_used_data":94944,"kb_used_omap":24,"kb_used_meta":444583,"kb_avail":1509409492,"statfs":{"total":1546188226560,"available":1545635319808,"internally_reserved":0,"allocated":97222656,"data_stored":120401995,"data_compressed":1076998,"data_compressed_allocated":2248704,"data_compressed_original":5402624,"omap_allocated":25521,"internal_metadata":455253071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4816896,"num_objects":12,"num_object_clones":12,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":39,"num_read_kb":15416,"num_write":65,"num_write_kb":4704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.945073"},"pg_stats":[{"pgid":"3.f","version":"60'6","reported_seq":137,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T16:42:33.510901+0000","last_change":"2024-09-17T16:42:33.514538+0000","last_active":"2024-09-17T16:42:33.510901+0000","last_peered":"2024-09-17T16:42:33.510901+0000","last_clean":"2024-09-17T16:42:33.510901+0000","last_became_active":"2024-09-17T16:42:08.901951+0000","last_became_peered":"2024-09-17T16:42:08.901951+0000","last_unstale":"2024-09-17T16:42:33.510901+0000","last_undegraded":"2024-09-17T16:42:33.510901+0000","last_fullsized":"2024-09-17T16:42:33.510901+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:20.827469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011680865,"stat_sum":{"num_bytes":638976,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1542,"num_write":22,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,14,11,7,10,0],"acting":[13,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"c","length":"2"}]},{"pgid":"3.e","version":"59'43","reported_seq":169,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.529052+0000","last_change":"2024-09-17T16:42:32.530192+0000","last_active":"2024-09-17T16:42:32.529052+0000","last_peered":"2024-09-17T16:42:32.529052+0000","last_clean":"2024-09-17T16:42:32.529052+0000","last_became_active":"2024-09-17T16:42:09.288377+0000","last_became_peered":"2024-09-17T16:42:09.288377+0000","last_unstale":"2024-09-17T16:42:32.529052+0000","last_undegraded":"2024-09-17T16:42:32.529052+0000","last_fullsized":"2024-09-17T16:42:32.529052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:14.744862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029353906999999999,"stat_sum":{"num_bytes":5275648,"num_objects":10,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":20,"num_read_kb":2946,"num_write":20,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,13,8,6,12],"acting":[2,11,5,13,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"d","length":"1"}]},{"pgid":"3.d","version":"37'4","reported_seq":135,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T16:42:33.503220+0000","last_change":"2024-09-17T16:42:33.503557+0000","last_active":"2024-09-17T16:42:33.503220+0000","last_peered":"2024-09-17T16:42:33.503220+0000","last_clean":"2024-09-17T16:42:33.503220+0000","last_became_active":"2024-09-17T16:42:09.119028+0000","last_became_peered":"2024-09-17T16:42:09.119028+0000","last_unstale":"2024-09-17T16:42:33.503220+0000","last_undegraded":"2024-09-17T16:42:33.503220+0000","last_fullsized":"2024-09-17T16:42:33.503220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:10.342260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083896100000000005,"stat_sum":{"num_bytes":671744,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,14,10,9,8,4],"acting":[13,1,14,10,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"c","length":"2"}]},{"pgid":"3.c","version":"61'103","reported_seq":252,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-17T16:42:34.534161+0000","last_change":"2024-09-17T16:42:34.534706+0000","last_active":"2024-09-17T16:42:34.534161+0000","last_peered":"2024-09-17T16:42:34.534161+0000","last_clean":"2024-09-17T16:42:34.534161+0000","last_became_active":"2024-09-17T16:42:09.287827+0000","last_became_peered":"2024-09-17T16:42:09.287827+0000","last_unstale":"2024-09-17T16:42:34.534161+0000","last_undegraded":"2024-09-17T16:42:34.534161+0000","last_fullsized":"2024-09-17T16:42:34.534161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:31.056259+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.026286484999999998,"stat_sum":{"num_bytes":8388608,"num_objects":14,"num_object_clones":6,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":51,"num_read_kb":9034,"num_write":80,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,10,6,12,3],"acting":[5,8,13,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"5"},{"start":"c","length":"2"}]},{"pgid":"3.b","version":"59'55","reported_seq":180,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.522383+0000","last_change":"2024-09-17T16:42:32.523373+0000","last_active":"2024-09-17T16:42:32.522383+0000","last_peered":"2024-09-17T16:42:32.522383+0000","last_clean":"2024-09-17T16:42:32.522383+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:42:32.522383+0000","last_undegraded":"2024-09-17T16:42:32.522383+0000","last_fullsized":"2024-09-17T16:42:32.522383+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:17.752539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022514161000000001,"stat_sum":{"num_bytes":3850240,"num_objects":10,"num_object_clones":4,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":2,"num_read":21,"num_read_kb":997,"num_write":22,"num_write_kb":5216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"d","length":"1"}]},{"pgid":"3.a","version":"60'21","reported_seq":159,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T16:42:33.597295+0000","last_change":"2024-09-17T16:42:33.514206+0000","last_active":"2024-09-17T16:42:33.597295+0000","last_peered":"2024-09-17T16:42:33.597295+0000","last_clean":"2024-09-17T16:42:33.597295+0000","last_became_active":"2024-09-17T16:42:09.120200+0000","last_became_peered":"2024-09-17T16:42:09.120200+0000","last_unstale":"2024-09-17T16:42:33.597295+0000","last_undegraded":"2024-09-17T16:42:33.597295+0000","last_fullsized":"2024-09-17T16:42:33.597295+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:10.799726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010984857000000001,"stat_sum":{"num_bytes":3735552,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":5356,"num_write":13,"num_write_kb":3648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,14,6,10],"acting":[13,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"c","length":"2"}]},{"pgid":"3.9","version":"55'31","reported_seq":150,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.497435+0000","last_change":"2024-09-17T16:42:31.497750+0000","last_active":"2024-09-17T16:42:31.497435+0000","last_peered":"2024-09-17T16:42:31.497435+0000","last_clean":"2024-09-17T16:42:31.497435+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:42:31.497435+0000","last_undegraded":"2024-09-17T16:42:31.497435+0000","last_fullsized":"2024-09-17T16:42:31.497435+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:14.165589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063103599999999997,"stat_sum":{"num_bytes":3325952,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":20,"num_read_kb":5251,"num_write":16,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"2"},{"start":"a","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.8","version":"42'17","reported_seq":135,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.491246+0000","last_change":"2024-09-17T16:42:31.491577+0000","last_active":"2024-09-17T16:42:31.491246+0000","last_peered":"2024-09-17T16:42:31.491246+0000","last_clean":"2024-09-17T16:42:31.491246+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:42:31.491246+0000","last_undegraded":"2024-09-17T16:42:31.491246+0000","last_fullsized":"2024-09-17T16:42:31.491246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.485629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061563299999999998,"stat_sum":{"num_bytes":1900544,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2403,"num_write":9,"num_write_kb":2464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"2"},{"start":"a","length":"1"},{"start":"d","length":"1"}]},{"pgid":"1.0","version":"24'92","reported_seq":79,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.490960+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:42:31.490960+0000","last_peered":"2024-09-17T16:42:31.490960+0000","last_clean":"2024-09-17T16:42:31.490960+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:42:31.490960+0000","last_undegraded":"2024-09-17T16:42:31.490960+0000","last_fullsized":"2024-09-17T16:42:31.490960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.491085+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:42:31.491085+0000","last_peered":"2024-09-17T16:42:31.491085+0000","last_clean":"2024-09-17T16:42:31.491085+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:42:31.491085+0000","last_undegraded":"2024-09-17T16:42:31.491085+0000","last_fullsized":"2024-09-17T16:42:31.491085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":114,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.491290+0000","last_change":"2024-09-17T16:42:31.491600+0000","last_active":"2024-09-17T16:42:31.491290+0000","last_peered":"2024-09-17T16:42:31.491290+0000","last_clean":"2024-09-17T16:42:31.491290+0000","last_became_active":"2024-09-17T16:42:09.120070+0000","last_became_peered":"2024-09-17T16:42:09.120070+0000","last_unstale":"2024-09-17T16:42:31.491290+0000","last_undegraded":"2024-09-17T16:42:31.491290+0000","last_fullsized":"2024-09-17T16:42:31.491290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.971108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054616799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,13,1,5,3,7],"acting":[11,2,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"2"},{"start":"a","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":77,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.502199+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:42:32.502199+0000","last_peered":"2024-09-17T16:42:32.502199+0000","last_clean":"2024-09-17T16:42:32.502199+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:42:32.502199+0000","last_undegraded":"2024-09-17T16:42:32.502199+0000","last_fullsized":"2024-09-17T16:42:32.502199+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"55'17","reported_seq":152,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.501150+0000","last_change":"2024-09-17T16:42:32.501502+0000","last_active":"2024-09-17T16:42:32.501150+0000","last_peered":"2024-09-17T16:42:32.501150+0000","last_clean":"2024-09-17T16:42:32.501150+0000","last_became_active":"2024-09-17T16:42:08.902123+0000","last_became_peered":"2024-09-17T16:42:08.902123+0000","last_unstale":"2024-09-17T16:42:32.501150+0000","last_undegraded":"2024-09-17T16:42:32.501150+0000","last_fullsized":"2024-09-17T16:42:32.501150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:30.941056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064265399999999999,"stat_sum":{"num_bytes":2490368,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":2107,"num_write":31,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,3,11,10,2,7],"acting":[4,13,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"d","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.654215+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:42:31.654215+0000","last_peered":"2024-09-17T16:42:31.654215+0000","last_clean":"2024-09-17T16:42:31.654215+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:42:31.654215+0000","last_undegraded":"2024-09-17T16:42:31.654215+0000","last_fullsized":"2024-09-17T16:42:31.654215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"42'11","reported_seq":125,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.497513+0000","last_change":"2024-09-17T16:42:31.497898+0000","last_active":"2024-09-17T16:42:31.497513+0000","last_peered":"2024-09-17T16:42:31.497513+0000","last_clean":"2024-09-17T16:42:31.497513+0000","last_became_active":"2024-09-17T16:42:08.817399+0000","last_became_peered":"2024-09-17T16:42:08.817399+0000","last_unstale":"2024-09-17T16:42:31.497513+0000","last_undegraded":"2024-09-17T16:42:31.497513+0000","last_fullsized":"2024-09-17T16:42:31.497513+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:11.219443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062023700000000005,"stat_sum":{"num_bytes":901120,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2315,"num_write":7,"num_write_kb":880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,13,11,4],"acting":[14,2,9,3,13,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"2"},{"start":"a","length":"1"},{"start":"d","length":"1"}]},{"pgid":"2.2","version":"30'2","reported_seq":80,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T16:42:33.503169+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:42:33.503169+0000","last_peered":"2024-09-17T16:42:33.503169+0000","last_clean":"2024-09-17T16:42:33.503169+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:42:33.503169+0000","last_undegraded":"2024-09-17T16:42:33.503169+0000","last_fullsized":"2024-09-17T16:42:33.503169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"55'24","reported_seq":151,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T16:42:31.654916+0000","last_change":"2024-09-17T16:42:31.655349+0000","last_active":"2024-09-17T16:42:31.654916+0000","last_peered":"2024-09-17T16:42:31.654916+0000","last_clean":"2024-09-17T16:42:31.654916+0000","last_became_active":"2024-09-17T16:42:08.901463+0000","last_became_peered":"2024-09-17T16:42:08.901463+0000","last_unstale":"2024-09-17T16:42:31.654916+0000","last_undegraded":"2024-09-17T16:42:31.654916+0000","last_fullsized":"2024-09-17T16:42:31.654916+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:31.296330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081410300000000005,"stat_sum":{"num_bytes":4046848,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":2373,"num_write":16,"num_write_kb":4464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,13,2,10,5],"acting":[15,9,4,13,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"2"},{"start":"a","length":"1"},{"start":"d","length":"1"}]},{"pgid":"3.5","version":"61'27","reported_seq":165,"reported_epoch":61,"state":"active+clean","last_fresh":"2024-09-17T16:42:34.517875+0000","last_change":"2024-09-17T16:42:34.519346+0000","last_active":"2024-09-17T16:42:34.517875+0000","last_peered":"2024-09-17T16:42:34.517875+0000","last_clean":"2024-09-17T16:42:34.517875+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:42:34.517875+0000","last_undegraded":"2024-09-17T16:42:34.517875+0000","last_fullsized":"2024-09-17T16:42:34.517875+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:31.312081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010858593,"stat_sum":{"num_bytes":2457600,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"5"},{"start":"c","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.500864+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:42:32.500864+0000","last_peered":"2024-09-17T16:42:32.500864+0000","last_clean":"2024-09-17T16:42:32.500864+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:42:32.500864+0000","last_undegraded":"2024-09-17T16:42:32.500864+0000","last_fullsized":"2024-09-17T16:42:32.500864+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"59'30","reported_seq":157,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.521077+0000","last_change":"2024-09-17T16:42:32.523156+0000","last_active":"2024-09-17T16:42:32.521077+0000","last_peered":"2024-09-17T16:42:32.521077+0000","last_clean":"2024-09-17T16:42:32.521077+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:42:32.521077+0000","last_undegraded":"2024-09-17T16:42:32.521077+0000","last_fullsized":"2024-09-17T16:42:32.521077+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:11.102642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017257679000000001,"stat_sum":{"num_bytes":2965504,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":2956,"num_write":16,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"d","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":72,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T16:42:30.482802+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:42:30.482802+0000","last_peered":"2024-09-17T16:42:30.482802+0000","last_clean":"2024-09-17T16:42:30.482802+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:42:30.482802+0000","last_undegraded":"2024-09-17T16:42:30.482802+0000","last_fullsized":"2024-09-17T16:42:30.482802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"59'31","reported_seq":157,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.512948+0000","last_change":"2024-09-17T16:42:32.513862+0000","last_active":"2024-09-17T16:42:32.512948+0000","last_peered":"2024-09-17T16:42:32.512948+0000","last_clean":"2024-09-17T16:42:32.512948+0000","last_became_active":"2024-09-17T16:42:08.914114+0000","last_became_peered":"2024-09-17T16:42:08.914114+0000","last_unstale":"2024-09-17T16:42:32.512948+0000","last_undegraded":"2024-09-17T16:42:32.512948+0000","last_fullsized":"2024-09-17T16:42:32.512948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:19.859777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012907546000000001,"stat_sum":{"num_bytes":4521984,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":1310,"num_write":19,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,13],"acting":[4,6,7,0,11,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"d","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":76,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.505857+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:42:32.505857+0000","last_peered":"2024-09-17T16:42:32.505857+0000","last_clean":"2024-09-17T16:42:32.505857+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:42:32.505857+0000","last_undegraded":"2024-09-17T16:42:32.505857+0000","last_fullsized":"2024-09-17T16:42:32.505857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"59'37","reported_seq":162,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-09-17T16:42:32.528947+0000","last_change":"2024-09-17T16:42:32.524961+0000","last_active":"2024-09-17T16:42:32.528947+0000","last_peered":"2024-09-17T16:42:32.528947+0000","last_clean":"2024-09-17T16:42:32.528947+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:42:32.528947+0000","last_undegraded":"2024-09-17T16:42:32.528947+0000","last_fullsized":"2024-09-17T16:42:32.528947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:17.765229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015781348000000001,"stat_sum":{"num_bytes":4358144,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":21,"num_write_kb":5072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"2"},{"start":"9","length":"2"},{"start":"d","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":78,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-09-17T16:42:33.502750+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:42:33.502750+0000","last_peered":"2024-09-17T16:42:33.502750+0000","last_clean":"2024-09-17T16:42:33.502750+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:42:33.502750+0000","last_undegraded":"2024-09-17T16:42:33.502750+0000","last_fullsized":"2024-09-17T16:42:33.502750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":49528832,"num_objects":82,"num_object_clones":32,"num_object_copies":574,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":7,"num_read":242,"num_read_kb":38603,"num_write":310,"num_write_kb":52432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87306240,"data_stored":115236864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":457,"ondisk_log_size":457,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182414,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":4664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":4775936,"data_stored":5934595,"data_compressed":65820,"data_compressed_allocated":135168,"data_compressed_original":270336,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182414,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31072,"kb_used_data":4040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340768,"statfs":{"total":96636764160,"available":96604946432,"internally_reserved":0,"allocated":4136960,"data_stored":4566497,"data_compressed":61784,"data_compressed_allocated":126976,"data_compressed_original":253952,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182414,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35068,"kb_used_data":8032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336772,"statfs":{"total":96636764160,"available":96600854528,"internally_reserved":0,"allocated":8224768,"data_stored":10416163,"data_compressed":73091,"data_compressed_allocated":167936,"data_compressed_original":794624,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":5764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":5902336,"data_stored":6858332,"data_compressed":67843,"data_compressed_allocated":139264,"data_compressed_original":278528,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35160,"kb_used_data":8128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336680,"statfs":{"total":96636764160,"available":96600760320,"internally_reserved":0,"allocated":8323072,"data_stored":11022024,"data_compressed":69867,"data_compressed_allocated":143360,"data_compressed_original":286720,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":5124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":5246976,"data_stored":6969468,"data_compressed":74295,"data_compressed_allocated":172032,"data_compressed_original":790528,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":5972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":6115328,"data_stored":7497308,"data_compressed":67843,"data_compressed_allocated":139264,"data_compressed_original":278528,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313229,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33308,"kb_used_data":6272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338532,"statfs":{"total":96636764160,"available":96602656768,"internally_reserved":0,"allocated":6422528,"data_stored":8330933,"data_compressed":69867,"data_compressed_allocated":143360,"data_compressed_original":286720,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313229,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30708,"kb_used_data":3672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341132,"statfs":{"total":96636764160,"available":96605319168,"internally_reserved":0,"allocated":3760128,"data_stored":5988021,"data_compressed":69867,"data_compressed_allocated":143360,"data_compressed_original":286720,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247822,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39896,"kb_used_data":8708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331944,"statfs":{"total":96636764160,"available":96595910656,"internally_reserved":0,"allocated":8916992,"data_stored":12211982,"data_compressed":71891,"data_compressed_allocated":147456,"data_compressed_original":294912,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215115,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30112,"kb_used_data":3080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341728,"statfs":{"total":96636764160,"available":96605929472,"internally_reserved":0,"allocated":3153920,"data_stored":3089906,"data_compressed":63802,"data_compressed_allocated":131072,"data_compressed_original":262144,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215118,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39148,"kb_used_data":7956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332692,"statfs":{"total":96636764160,"available":96596676608,"internally_reserved":0,"allocated":8146944,"data_stored":9631218,"data_compressed":63802,"data_compressed_allocated":131072,"data_compressed_original":262144,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215117,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35488,"kb_used_data":8456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336352,"statfs":{"total":96636764160,"available":96600424448,"internally_reserved":0,"allocated":8658944,"data_stored":10323442,"data_compressed":63802,"data_compressed_allocated":131072,"data_compressed_original":262144,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215117,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36672,"kb_used_data":5480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335168,"statfs":{"total":96636764160,"available":96599212032,"internally_reserved":0,"allocated":5611520,"data_stored":6526469,"data_compressed":63802,"data_compressed_allocated":131072,"data_compressed_original":262144,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182414,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31236,"kb_used_data":4200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340604,"statfs":{"total":96636764160,"available":96604778496,"internally_reserved":0,"allocated":4300800,"data_stored":4793842,"data_compressed":63802,"data_compressed_allocated":131072,"data_compressed_original":262144,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182412,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":5396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":5525504,"data_stored":6241795,"data_compressed":65820,"data_compressed_allocated":135168,"data_compressed_original":270336,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5263360,"data_stored":7643136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2539520,"data_stored":2691072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4554752,"data_stored":7413760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3686400,"data_stored":4395008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5476352,"data_stored":7872512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8179712,"data_stored":10969088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7532544,"data_stored":9232384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4898816,"data_stored":5832704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5771264,"data_stored":7397376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":3108864,"data_stored":5558272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":8044544,"data_stored":9924608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":7557120,"data_stored":9478144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4993024,"data_stored":6127616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8015872,"data_stored":10997760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":3534848,"data_stored":4177920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4149248,"data_stored":5525504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:36.388 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [4, 15, 13, 5] 2024-09-17T16:42:36.388 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.0', '4', '15', '13', '5'] 2024-09-17T16:42:36.388 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.0 4 15 13 5 2024-09-17T16:42:36.436 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.436 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.441 INFO:tasks.rados.rados.0.smithi183.stdout:185: done (2 left) 2024-09-17T16:42:36.441 INFO:tasks.rados.rados.0.smithi183.stdout:186: copy_from oid 8 from oid 30 current snap is 13 2024-09-17T16:42:36.441 INFO:tasks.rados.rados.0.smithi183.stdout:187: rollback oid 40 current snap is 13 2024-09-17T16:42:36.441 INFO:tasks.rados.rados.0.smithi183.stdout:187: done (3 left) 2024-09-17T16:42:36.441 INFO:tasks.rados.rados.0.smithi183.stdout:188: snap_create 2024-09-17T16:42:36.441 INFO:tasks.rados.rados.0.smithi183.stdout:182: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:42:36.442 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:36.443 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 22173 2024-09-17T16:42:36.446 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 116357 2024-09-17T16:42:36.448 INFO:tasks.rados.rados.0.smithi183.stdout:184: finishing write tid 1 to smithi18337221-14 2024-09-17T16:42:36.448 INFO:tasks.rados.rados.0.smithi183.stdout:184: finishing write tid 2 to smithi18337221-14 2024-09-17T16:42:36.448 INFO:tasks.rados.rados.0.smithi183.stdout:184: finishing write tid 3 to smithi18337221-14 2024-09-17T16:42:36.448 INFO:tasks.rados.rados.0.smithi183.stdout:184: finishing write tid 4 to smithi18337221-14 2024-09-17T16:42:36.448 INFO:tasks.rados.rados.0.smithi183.stdout:184: finishing write tid 5 to smithi18337221-14 2024-09-17T16:42:36.448 INFO:tasks.rados.rados.0.smithi183.stdout:184: oid 14 updating version 0 to 109 2024-09-17T16:42:36.449 INFO:tasks.rados.rados.0.smithi183.stdout:184: oid 14 updating version 109 to 111 2024-09-17T16:42:36.449 INFO:tasks.rados.rados.0.smithi183.stdout:184: oid 14 version 111 is already newer than 110 2024-09-17T16:42:36.449 INFO:tasks.rados.rados.0.smithi183.stdout:184: oid 14 version 111 is already newer than 104 2024-09-17T16:42:36.449 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 14 v 111 (ObjNum 86 snap 13 seq_num 86) dirty exists 2024-09-17T16:42:36.449 INFO:tasks.rados.rados.0.smithi183.stdout:184: left oid 14 (ObjNum 86 snap 13 seq_num 86) 2024-09-17T16:42:36.450 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:36.458 INFO:tasks.rados.rados.0.smithi183.stdout:186: finishing copy_from racing read to smithi18337221-8 2024-09-17T16:42:36.459 INFO:tasks.rados.rados.0.smithi183.stdout:186: finishing copy_from to smithi18337221-8 2024-09-17T16:42:36.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 8 v 61 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T16:42:36.477 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:36.475+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:36.555 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.555 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.563 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:36.578 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:36.576+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:36.679 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:36.677+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:36.706 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.707 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.715 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:36.780 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:36.778+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:36.817 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.818 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.826 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:36.881 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:36.879+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:36.929 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:36.929 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:36.938 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:36.981 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:36.979+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:37.040 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.040 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.049 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:37.090 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:37.088+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:37.182 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:37.180+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:37.193 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.193 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:37.283 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:37.281+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:37.310 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.310 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:37.384 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:37.382+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:37.425 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.425 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:set 2.0 pg_upmap_items mapping to [4->15,13->5] 2024-09-17T16:42:37.442 INFO:tasks.rados.rados.0.smithi183.stdout:182: done (3 left) 2024-09-17T16:42:37.442 INFO:tasks.rados.rados.0.smithi183.stdout:184: done (2 left) 2024-09-17T16:42:37.442 INFO:tasks.rados.rados.0.smithi183.stdout:186: done (1 left) 2024-09-17T16:42:37.442 INFO:tasks.rados.rados.0.smithi183.stdout:188: done (0 left) 2024-09-17T16:42:37.443 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 24 current snap is 14 2024-09-17T16:42:37.443 INFO:tasks.rados.rados.0.smithi183.stdout:189: seq_num 87 ranges {819200=704512,1523712=688128,2211840=81920} 2024-09-17T16:42:37.450 INFO:tasks.rados.rados.0.smithi183.stdout:189: writing smithi18337221-24 from 819200 to 1523712 tid 1 2024-09-17T16:42:37.454 INFO:tasks.rados.rados.0.smithi183.stdout:189: writing smithi18337221-24 from 1523712 to 2211840 tid 2 2024-09-17T16:42:37.455 INFO:tasks.rados.rados.0.smithi183.stdout:189: writing smithi18337221-24 from 2211840 to 2293760 tid 3 2024-09-17T16:42:37.455 INFO:tasks.rados.rados.0.smithi183.stdout:190: delete oid 1 current snap is 14 2024-09-17T16:42:37.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:42:37.461 INFO:tasks.rados.rados.0.smithi183.stdout:190: done (1 left) 2024-09-17T16:42:37.461 INFO:tasks.rados.rados.0.smithi183.stdout:191: delete oid 19 current snap is 14 2024-09-17T16:42:37.463 INFO:tasks.rados.rados.0.smithi183.stdout:191: done (1 left) 2024-09-17T16:42:37.463 INFO:tasks.rados.rados.0.smithi183.stdout:192: snap_create 2024-09-17T16:42:37.467 INFO:tasks.rados.rados.0.smithi183.stdout:189: finishing write tid 1 to smithi18337221-24 2024-09-17T16:42:37.469 INFO:tasks.rados.rados.0.smithi183.stdout:189: finishing write tid 2 to smithi18337221-24 2024-09-17T16:42:37.469 INFO:tasks.rados.rados.0.smithi183.stdout:189: finishing write tid 3 to smithi18337221-24 2024-09-17T16:42:37.469 INFO:tasks.rados.rados.0.smithi183.stdout:189: finishing write tid 4 to smithi18337221-24 2024-09-17T16:42:37.470 INFO:tasks.rados.rados.0.smithi183.stdout:189: finishing write tid 5 to smithi18337221-24 2024-09-17T16:42:37.470 INFO:tasks.rados.rados.0.smithi183.stdout:189: oid 24 updating version 0 to 82 2024-09-17T16:42:37.470 INFO:tasks.rados.rados.0.smithi183.stdout:189: oid 24 updating version 82 to 84 2024-09-17T16:42:37.470 INFO:tasks.rados.rados.0.smithi183.stdout:189: oid 24 version 84 is already newer than 81 2024-09-17T16:42:37.471 INFO:tasks.rados.rados.0.smithi183.stdout:189: oid 24 version 84 is already newer than 83 2024-09-17T16:42:37.471 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 24 v 84 (ObjNum 87 snap 14 seq_num 87) dirty exists 2024-09-17T16:42:37.471 INFO:tasks.rados.rados.0.smithi183.stdout:189: left oid 24 (ObjNum 87 snap 14 seq_num 87) 2024-09-17T16:42:37.485 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:37.483+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.553 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:37.587 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:37.584+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:37.595 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:37.673 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.673 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:37.687 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:37.685+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:37.749 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:37.749 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:37.767 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:37.785 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:37.785 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:37.788 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:37.786+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:37.802 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:37.802 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:37.802 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:37.802 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:37.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:37.819 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:37.819 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:37.837 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:37.837 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:37.854 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:37.855 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:37.871 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:37.871 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:37.888 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:37.888 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:37.889 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:37.886+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:37.905 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:37.906 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:37.922 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.444300566999999, 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:37.923 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:37.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:42:37.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:42:37.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:37.930 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.442367814000001, 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:42:37.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.441940822999999, 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.937 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:42:37.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:42:37.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.441907358999998, 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:37.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:37.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:42:37.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.441861053, 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.950 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:42:37.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:37.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.4418012, 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:42:37.956 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:42:37.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:42:37.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:42:37.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.5.23:2 3.bs0 3:d08ffbb6:::smithi18337221-30:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.436530759, 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025206989999999999, 2024-09-17T16:42:37.962 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483332+0000", 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9630000000000001e-06 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483339+0000", 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483351+0000", 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:42:37.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483359+0000", 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506020+0000", 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022660777 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506121+0000", 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010158999999999999 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508537+0000", 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002415848 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:37.966 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.431870591999999, 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016316462, 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487992+0000", 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1400000000000001e-06 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487999+0000", 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1459999999999999e-06 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488012+0000", 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3499000000000001e-05 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488021+0000", 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6519999999999995e-06 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504215+0000", 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016193754000000001 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504307+0000", 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2270999999999998e-05 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:37.970 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.431120273000001, 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01555453, 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488741+0000", 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488742+0000", 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7899999999999997e-07 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488747+0000", 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3759999999999999e-06 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488766+0000", 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8739000000000001e-05 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488775+0000", 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1889999999999996e-06 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504279+0000", 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015503576 2024-09-17T16:42:37.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504295+0000", 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6770999999999999e-05 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.431036208999998, 2024-09-17T16:42:37.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015687293000000001, 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488825+0000", 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488826+0000", 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488829+0000", 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9589999999999997e-06 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488839+0000", 2024-09-17T16:42:37.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6840000000000008e-06 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488845+0000", 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504490+0000", 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015645032 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504512+0000", 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1790999999999999e-05 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:212 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.429257547999999, 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014567019, 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.978 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 212 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490604+0000", 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490605+0000", 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.074e-06 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490610+0000", 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8370000000000002e-06 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490626+0000", 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.571e-05 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490645+0000", 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8952000000000001e-05 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490964+0000", 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031921400000000001 2024-09-17T16:42:37.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491049+0000", 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4197999999999996e-05 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505171+0000", 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014122034 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:213 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.429201046999999, 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017648329000000001, 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 213 2024-09-17T16:42:37.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490661+0000", 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490665+0000", 2024-09-17T16:42:37.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1010000000000002e-06 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490675+0000", 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0467e-05 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490681+0000", 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8939999999999998e-06 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492163+0000", 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001481794 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492244+0000", 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0897999999999997e-05 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508308+0000", 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016064544 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.987 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:295 3.bs0 3:d855b096:::smithi18337221-24:head [copy-from ver 7] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.454568174, 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016204202000000001, 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.988 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 295 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465294+0000", 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.451e-06 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465300+0000", 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6659999999999996e-06 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465314+0000", 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4443e-05 2024-09-17T16:42:37.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465322+0000", 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.52e-06 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465665+0000", 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034335499999999999 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465770+0000", 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104732 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473519+0000", 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077493609999999997 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479834+0000", 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063149369999999996 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481444+0000", 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0016096330000000001 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481497+0000", 2024-09-17T16:42:37.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3103999999999998e-05 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:351 3.7s0 3:e31d051c:::smithi18337221-15:head [copy-from ver 8] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4403832679999997, 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023291879000000001, 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:37.994 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 351 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479479+0000", 2024-09-17T16:42:37.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.671e-06 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479487+0000", 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.763e-06 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479504+0000", 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6891000000000001e-05 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:37.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479513+0000", 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0690000000000008e-06 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479567+0000", 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3599e-05 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479657+0000", 2024-09-17T16:42:37.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9906000000000003e-05 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.493160+0000", 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013503724999999999 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.500514+0000", 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073532679999999996 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:37.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502657+0000", 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002143407 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502770+0000", 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011258 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:352 3.7s0 3:e31d051c:::smithi18337221-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:38.000 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4403288179999993, 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020327753, 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 352 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479533+0000", 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3200000000000005e-07 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479537+0000", 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.403e-06 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479548+0000", 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0444e-05 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479555+0000", 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0559999999999999e-06 2024-09-17T16:42:38.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479795+0000", 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023998499999999999 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479858+0000", 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2729000000000002e-05 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499619+0000", 2024-09-17T16:42:38.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019761535 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499738+0000", 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118867 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499860+0000", 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012210199999999999 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:433 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~622592] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4043411829999997, 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019410863, 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 433 2024-09-17T16:42:38.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515522+0000", 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8160000000000001e-06 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516965+0000", 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014435629999999999 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516981+0000", 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5681000000000001e-05 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516991+0000", 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8239999999999995e-06 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517069+0000", 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8172999999999998e-05 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517201+0000", 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000132101 2024-09-17T16:42:38.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518296+0000", 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010954490000000001 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532966+0000", 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014669013 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534841+0000", 2024-09-17T16:42:38.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018757509999999999 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534931+0000", 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9492000000000003e-05 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:434 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~475136] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.4009487900000002, 2024-09-17T16:42:38.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017119724999999999, 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 434 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:38.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518914+0000", 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519590+0000", 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067595600000000002 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519604+0000", 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4391e-05 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519613+0000", 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4179999999999997e-06 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.524975+0000", 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053627240000000001 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.525091+0000", 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115345 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.526035+0000", 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00094401900000000004 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533023+0000", 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069880280000000003 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.535985+0000", 2024-09-17T16:42:38.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029618489999999999 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.536032+0000", 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7379000000000002e-05 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:435 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~294912] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.3989991259999996, 2024-09-17T16:42:38.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018146874, 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 435 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:38.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520863+0000", 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4050000000000001e-06 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521158+0000", 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029489000000000002 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521173+0000", 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5228000000000001e-05 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521184+0000", 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0332999999999999e-05 2024-09-17T16:42:38.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529465+0000", 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082808810000000004 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529536+0000", 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.161e-05 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.530071+0000", 2024-09-17T16:42:38.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053491699999999999 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533025+0000", 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002953401 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.538970+0000", 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059453010000000001 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539009+0000", 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8908000000000001e-05 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:436 3.1s0 3:845a4d43:::smithi18337221-2:head [setxattr _header (56) in=7b] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.3986626739999997, 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017989387999999999, 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 436 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521199+0000", 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9999999999999997e-07 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521213+0000", 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4215e-05 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521223+0000", 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9340000000000001e-06 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521229+0000", 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0329999999999997e-06 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532021+0000", 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010791558 2024-09-17T16:42:38.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532136+0000", 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115529 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532681+0000", 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054450799999999997 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533396+0000", 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071506499999999997 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539125+0000", 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057293409999999998 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539188+0000", 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2504999999999999e-05 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.030 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:437 3.1s0 3:845a4d43:::smithi18337221-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.3986216640000002, 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018905465, 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.031 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 437 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521240+0000", 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521242+0000", 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.43e-06 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521251+0000", 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4910000000000005e-06 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521256+0000", 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0629999999999996e-06 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533246+0000", 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011990466999999999 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533313+0000", 2024-09-17T16:42:38.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7045999999999995e-05 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539424+0000", 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061101920000000004 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539475+0000", 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1892999999999999e-05 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.540145+0000", 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00066938200000000005 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.036 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:38.037 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:38.037 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:38.038 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:38.038 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:38.038 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:38.039 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:38.039 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:38.039 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:38.040 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:38.040 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:38.041 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:38.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:37.990+0000 7f8955dd0640 0 -- 172.21.15.60:0/3109819481 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f8950221d80 msgr2=0x7f8950224170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:38.041 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:38.042 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:38.042 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:38.039+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:38.142 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:38.140+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:38.185 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:38.185 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:38.185 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:38.185 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:38.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:38.242 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:38.240+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:38.300 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:38.300 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:38.300 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:38.300 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:38.300 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:38.309 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:38.343 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:38.341+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:38.416 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:38.417 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:38.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:38.417 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:38.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.420 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:178 3.4s0 3:216603c8:::smithi18337221-7:head [copy-from ver 2] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.953428860999999, 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0097627789999999992, 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.421 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 178 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460520+0000", 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3209999999999999e-06 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460526+0000", 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4590000000000003e-06 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460539+0000", 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2634e-05 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460546+0000", 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0450000000000003e-06 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460588+0000", 2024-09-17T16:42:38.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1984999999999999e-05 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460652+0000", 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4475999999999997e-05 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.466465+0000", 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058132269999999998 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469088+0000", 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026224709999999999 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470220+0000", 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001132248 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470281+0000", 2024-09-17T16:42:38.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0912999999999998e-05 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:179 3.4s0 3:216603c8:::smithi18337221-7:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.953388756999999, 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084466430000000002, 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 179 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460559+0000", 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6800000000000001e-07 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460562+0000", 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5410000000000001e-06 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460569+0000", 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2160000000000003e-06 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460576+0000", 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1230000000000002e-06 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460781+0000", 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00020571599999999999 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460810+0000", 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8632999999999998e-05 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468798+0000", 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0079879180000000001 2024-09-17T16:42:38.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468900+0000", 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000101611 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469005+0000", 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105417 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:199 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 764485~497083,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.936133006999999, 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010265850999999999, 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 199 2024-09-17T16:42:38.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477816+0000", 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8530000000000001e-06 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477825+0000", 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8850000000000005e-06 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477841+0000", 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6070999999999999e-05 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477851+0000", 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0261999999999999e-05 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477947+0000", 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5457000000000004e-05 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477956+0000", 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9639999999999992e-06 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480792+0000", 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028365840000000001 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480879+0000", 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7130000000000001e-05 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488080+0000", 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072006450000000003 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.438 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:200 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.936067755, 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011662507000000001, 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 200 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.439 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477880+0000", 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8599999999999998e-07 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477886+0000", 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5740000000000001e-06 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477906+0000", 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9604000000000001e-05 2024-09-17T16:42:38.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477914+0000", 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5859999999999999e-06 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478028+0000", 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011431500000000001 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478034+0000", 2024-09-17T16:42:38.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0530000000000003e-06 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481597+0000", 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035624699999999999 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481685+0000", 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8129999999999998e-05 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489542+0000", 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078571890000000005 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:201 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.936018090000001, 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013839093, 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.444 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 201 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477930+0000", 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1189999999999999e-06 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477949+0000", 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1701e-05 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477955+0000", 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6529999999999997e-06 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121858 2024-09-17T16:42:38.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478083+0000", 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7150000000000003e-06 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482035+0000", 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039517290000000002 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482114+0000", 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9499000000000006e-05 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491768+0000", 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096540259999999996 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:38.449 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.932359695999999, 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082527759999999999, 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:38.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481588+0000", 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.41e-07 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481637+0000", 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9536999999999997e-05 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481649+0000", 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1718e-05 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481658+0000", 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0589999999999992e-06 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482410+0000", 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00075179700000000001 2024-09-17T16:42:38.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482422+0000", 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1980999999999999e-05 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489809+0000", 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073877420000000001 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489840+0000", 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0701000000000003e-05 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.931189616000001, 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071068959999999997, 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.454 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482758+0000", 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482780+0000", 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1294e-05 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482790+0000", 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0736e-05 2024-09-17T16:42:38.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482801+0000", 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0474e-05 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482990+0000", 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00018943399999999999 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483000+0000", 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4259999999999992e-06 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489844+0000", 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068445470000000003 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489864+0000", 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9993999999999999e-05 2024-09-17T16:42:38.458 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.930746753000001, 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066866139999999996, 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483201+0000", 2024-09-17T16:42:38.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1090000000000001e-06 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483218+0000", 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6175999999999999e-05 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483230+0000", 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2149e-05 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483236+0000", 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4740000000000002e-06 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483520+0000", 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028360700000000001 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483531+0000", 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:42:38.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489867+0000", 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063354129999999998 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489887+0000", 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0285e-05 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.920559207, 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096456860000000005, 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493389+0000", 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.057e-06 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495399+0000", 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002010529 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495410+0000", 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0983e-05 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495418+0000", 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0120000000000005e-06 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495585+0000", 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000166274 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495592+0000", 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5580000000000003e-06 2024-09-17T16:42:38.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502976+0000", 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073836580000000004 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503034+0000", 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7615000000000003e-05 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.952811007999999, 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010978876, 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:38.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462292+0000", 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001155611 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462308+0000", 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6039e-05 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462318+0000", 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3989999999999993e-06 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462380+0000", 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2589999999999995e-05 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462390+0000", 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0020999999999999e-05 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472076+0000", 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096855420000000001 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472115+0000", 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9242999999999997e-05 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.2.22:1 3.4s0 3:2e95bc92:::smithi18337221-17:head [assert-version v4,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.481477+0000", 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9324704029999999, 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0067034039999999996, 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481477+0000", 2024-09-17T16:42:38.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481477+0000", 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481479+0000", 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.863e-06 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481487+0000", 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.303e-06 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481501+0000", 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3943e-05 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481510+0000", 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9949999999999994e-06 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481590+0000", 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9825000000000002e-05 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481597+0000", 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5059999999999998e-06 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.483814+0000", 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022168359999999998 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.483916+0000", 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000101928 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.488180+0000", 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042642050000000001 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.478 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9175667829999998, 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013323026999999999, 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496381+0000", 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496856+0000", 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047436000000000001 2024-09-17T16:42:38.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496867+0000", 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.165e-05 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496876+0000", 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8650000000000007e-06 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496951+0000", 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4673999999999997e-05 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496961+0000", 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.048e-05 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012637884 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509703+0000", 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104149 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9150354360000001, 2024-09-17T16:42:38.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072169349999999998, 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:38.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6700000000000002e-07 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499364+0000", 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045188699999999999 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499381+0000", 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6317999999999999e-05 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499389+0000", 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1960000000000008e-06 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499456+0000", 2024-09-17T16:42:38.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7556000000000002e-05 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499465+0000", 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1799999999999996e-06 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506091+0000", 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066263529999999998 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506129+0000", 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7577999999999998e-05 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.488 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.502725+0000", 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9112217909999991, 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085945380000000005, 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502725+0000", 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502725+0000", 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502726+0000", 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8199999999999999e-07 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503293+0000", 2024-09-17T16:42:38.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00056727899999999996 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503306+0000", 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2724e-05 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503314+0000", 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0539999999999995e-06 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503377+0000", 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2874999999999997e-05 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503386+0000", 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3729999999999999e-06 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511283+0000", 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00789662 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511320+0000", 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6831e-05 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9081651270000002, 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088565450000000004, 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505783+0000", 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2600000000000001e-07 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506045+0000", 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026176500000000001 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506148+0000", 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000102982 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506157+0000", 2024-09-17T16:42:38.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9840000000000007e-06 2024-09-17T16:42:38.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506467+0000", 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00030994099999999999 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506482+0000", 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5934999999999999e-05 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514604+0000", 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0081217470000000003 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514638+0000", 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4264999999999998e-05 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.499 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:384 3.4s0 3:2e95bc92:::smithi18337221-17:head [rollback 8] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.8238202860000001, 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065397579999999997, 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 384 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590130+0000", 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.852e-06 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590138+0000", 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7959999999999996e-06 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590143+0000", 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5249999999999996e-06 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.591414+0000", 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012708870000000001 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.591497+0000", 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2565999999999995e-05 2024-09-17T16:42:38.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.591861+0000", 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00036452700000000002 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592875+0000", 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010132170000000001 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596612+0000", 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003737888 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596667+0000", 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4098000000000003e-05 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:385 3.4s0 3:2e95bc92:::smithi18337221-17:head [append 0~0] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:38.505 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.8237733709999997, 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066138500000000001, 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 385 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.506 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0399999999999996e-07 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590177+0000", 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.914e-06 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590183+0000", 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1689999999999997e-06 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590189+0000", 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4829999999999999e-06 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592151+0000", 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019623100000000001 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592227+0000", 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5537000000000005e-05 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592549+0000", 2024-09-17T16:42:38.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00032248800000000001 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.593022+0000", 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047337600000000002 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596742+0000", 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0037197509999999999 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596788+0000", 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5318000000000002e-05 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.9215397900000006, 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095737730000000007, 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:38.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1600000000000001e-07 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493082+0000", 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067486599999999999 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493097+0000", 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4405e-05 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493107+0000", 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0254999999999999e-05 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493184+0000", 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.661e-05 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493194+0000", 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0156000000000001e-05 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501938+0000", 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087447870000000004 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501981+0000", 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2577999999999998e-05 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.515 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/34 ECSubWrite(tid=106, reqid=client.4553.0:401, at_version=56'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.497580+0000", 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.9163671650000005, 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080438509999999994, 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497580+0000", 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497580+0000", 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497581+0000", 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.015e-06 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497808+0000", 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00022724299999999999 2024-09-17T16:42:38.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497821+0000", 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3139000000000001e-05 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497828+0000", 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8600000000000004e-06 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498759+0000", 2024-09-17T16:42:38.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00093102899999999999 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498772+0000", 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2665e-05 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.505584+0000", 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068122520000000004 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.505624+0000", 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9647999999999997e-05 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.502330+0000", 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 8.9116169379999999, 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065842970000000002, 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.520 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502330+0000", 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502330+0000", 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502331+0000", 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.23e-07 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502672+0000", 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034076700000000001 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502688+0000", 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6286999999999998e-05 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502697+0000", 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6719999999999993e-06 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502784+0000", 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7158999999999997e-05 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502793+0000", 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4320000000000005e-06 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508872+0000", 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006078656 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508914+0000", 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2601000000000001e-05 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.524 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:38.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:189: done (1 left) 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:192: done (0 left) 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:193: read oid 38 snap -1 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:193: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:194: read oid 8 snap -1 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:194: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:195: read oid 29 snap -1 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:195: expect (ObjNum 60 snap 5 seq_num 60) 2024-09-17T16:42:38.530 INFO:tasks.rados.rados.0.smithi183.stdout:196: rollback oid 37 current snap is 15 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 37 to 13 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 31 current snap is 15 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:197: seq_num 90 ranges {507904=753664,1261568=720896,1982464=49152} 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:197: writing smithi18337221-31 from 507904 to 1261568 tid 1 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:197: writing smithi18337221-31 from 1261568 to 1982464 tid 2 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:197: writing smithi18337221-31 from 1982464 to 2031616 tid 3 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:198: setattr oid 33 current snap is 15 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:196: finishing rollback tid 0 to smithi18337221-37 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:193: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 80752 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.531 INFO:tasks.rados.rados.0.smithi183.stdout:194: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:196: finishing rollback tid 1 to smithi18337221-37 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:196: finishing rollback tid 2 to smithi18337221-37 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 49 (ObjNum 71 snap 10 seq_num 71) dirty exists 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:195: expect (ObjNum 60 snap 5 seq_num 60) 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:197: finishing write tid 1 to smithi18337221-31 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:197: finishing write tid 2 to smithi18337221-31 2024-09-17T16:42:38.532 INFO:tasks.rados.rados.0.smithi183.stdout:197: finishing write tid 3 to smithi18337221-31 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: finishing write tid 4 to smithi18337221-31 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: finishing write tid 5 to smithi18337221-31 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: oid 31 updating version 0 to 28 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: oid 31 version 28 is already newer than 27 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: oid 31 updating version 28 to 30 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: oid 31 version 30 is already newer than 29 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 31 v 30 (ObjNum 90 snap 15 seq_num 90) dirty exists 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: left oid 31 (ObjNum 90 snap 15 seq_num 90) 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 128 (ObjNum 68 snap 10 seq_num 68) dirty exists 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:193: done (5 left) 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:194: done (4 left) 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:195: done (3 left) 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:196: done (2 left) 2024-09-17T16:42:38.533 INFO:tasks.rados.rados.0.smithi183.stdout:197: done (1 left) 2024-09-17T16:42:38.534 INFO:tasks.rados.rados.0.smithi183.stdout:198: done (0 left) 2024-09-17T16:42:38.534 INFO:tasks.rados.rados.0.smithi183.stdout:199: delete oid 31 current snap is 15 2024-09-17T16:42:38.534 INFO:tasks.rados.rados.0.smithi183.stdout:199: done (0 left) 2024-09-17T16:42:38.534 INFO:tasks.rados.rados.0.smithi183.stdout:200: snap_create 2024-09-17T16:42:38.534 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:38.524+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:38.629 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:38.627+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:38.675 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:38.675 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:38.675 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:38.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:38.730 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:38.728+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:38.790 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:38.791 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:38.791 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:38.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:38.831 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:38.829+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:38.932 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:38.930+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:38.947 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:38.947 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:38.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:38.947 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:38.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.462190922000001, 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011223067999999999, 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499999999999999e-07 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482482+0000", 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014705100000000001 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482496+0000", 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4164e-05 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482513+0000", 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6529e-05 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482631+0000", 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011836999999999999 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482642+0000", 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0895e-05 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493489+0000", 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010846876 2024-09-17T16:42:38.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493558+0000", 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8827999999999999e-05 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.449703656000001, 2024-09-17T16:42:38.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082916329999999996, 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494823+0000", 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.201e-06 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495212+0000", 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038936199999999998 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495232+0000", 2024-09-17T16:42:38.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9830000000000002e-05 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495243+0000", 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0589e-05 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495340+0000", 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6824999999999995e-05 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495350+0000", 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0778000000000001e-05 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503052+0000", 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077014559999999998 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503113+0000", 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1592000000000003e-05 2024-09-17T16:42:38.956 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.501427+0000", 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.4430987, 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0050050909999999997, 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501427+0000", 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501427+0000", 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501428+0000", 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6109999999999999e-06 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501499+0000", 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0449000000000003e-05 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501522+0000", 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3209000000000001e-05 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501547+0000", 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4579999999999998e-05 2024-09-17T16:42:38.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501698+0000", 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015181299999999999 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.501710+0000", 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1464000000000001e-05 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506157+0000", 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044470940000000004 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506432+0000", 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027487099999999999 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=52, reqid=client.4553.0:187, at_version=40'24, trim_to=0'0, roll_forward_to=40'23))", 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.511074+0000", 2024-09-17T16:42:38.961 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.433451188999999, 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005749049, 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511074+0000", 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511074+0000", 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511075+0000", 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5600000000000004e-07 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511168+0000", 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2995e-05 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511186+0000", 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8094e-05 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511196+0000", 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.38e-06 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511260+0000", 2024-09-17T16:42:38.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4209999999999997e-05 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.511273+0000", 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3055e-05 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516796+0000", 2024-09-17T16:42:38.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055226729999999996 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516823+0000", 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7685999999999999e-05 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:38.966 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.482964326999999, 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010954281999999999, 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461562+0000", 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3300000000000002e-07 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462055+0000", 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00049369500000000005 2024-09-17T16:42:38.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462066+0000", 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1012000000000001e-05 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462074+0000", 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1790000000000008e-06 2024-09-17T16:42:38.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462143+0000", 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8353000000000001e-05 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462154+0000", 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0773e-05 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472429+0000", 2024-09-17T16:42:38.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010275876999999999 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472515+0000", 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5859999999999994e-05 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.473581+0000", 2024-09-17T16:42:38.971 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.470944475, 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0060366960000000002, 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473581+0000", 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473581+0000", 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473582+0000", 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7100000000000011e-07 2024-09-17T16:42:38.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473737+0000", 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015486699999999999 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473751+0000", 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4474999999999999e-05 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473760+0000", 2024-09-17T16:42:38.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3380000000000005e-06 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473823+0000", 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3415000000000002e-05 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473842+0000", 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479578+0000", 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005735853 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479618+0000", 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9514999999999997e-05 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.976 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 55/34 ECSubWrite(tid=126, reqid=osd.4.0:126, at_version=55'43, trim_to=0'0, roll_forward_to=55'41))", 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.496627+0000", 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.447898344, 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065813779999999997, 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496627+0000", 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496627+0000", 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496628+0000", 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496651+0000", 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3042000000000001e-05 2024-09-17T16:42:38.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496663+0000", 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.183e-05 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496671+0000", 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5199999999999997e-06 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496733+0000", 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2162999999999994e-05 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496742+0000", 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1160000000000005e-06 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503154+0000", 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0064112459999999998 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503208+0000", 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4731999999999997e-05 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:38.981 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.447259287, 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012371190000000001, 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:38.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497267+0000", 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3900000000000004e-07 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497341+0000", 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4518999999999996e-05 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497362+0000", 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1165000000000001e-05 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497371+0000", 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.85e-06 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497442+0000", 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0967e-05 2024-09-17T16:42:38.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497451+0000", 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6989999999999992e-06 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012148320000000001 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509637+0000", 2024-09-17T16:42:38.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8031000000000002e-05 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.445463924, 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015236921, 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.986 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499063+0000", 2024-09-17T16:42:38.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1850000000000001e-06 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499453+0000", 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039015399999999998 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499469+0000", 2024-09-17T16:42:38.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6203000000000001e-05 2024-09-17T16:42:38.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499478+0000", 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6039999999999993e-06 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499561+0000", 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3509000000000003e-05 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499570+0000", 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1050000000000001e-06 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514274+0000", 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014703344 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514298+0000", 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4817e-05 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.991 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.441539468, 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082760230000000004, 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502987+0000", 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.035e-06 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503283+0000", 2024-09-17T16:42:38.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029568200000000002 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503296+0000", 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3321e-05 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503305+0000", 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7620000000000001e-06 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:38.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503370+0000", 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5180999999999998e-05 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503380+0000", 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0489000000000001e-05 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:38.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511230+0000", 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078494970000000004 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511262+0000", 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2055999999999999e-05 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.439284015, 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090908770000000007, 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505242+0000", 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4099999999999997e-07 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505687+0000", 2024-09-17T16:42:38.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00044460700000000002 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505704+0000", 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7407000000000001e-05 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505714+0000", 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5829999999999996e-06 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:38.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505775+0000", 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1254999999999995e-05 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505785+0000", 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9559999999999992e-06 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514308+0000", 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085228439999999999 2024-09-17T16:42:39.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514332+0000", 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4383999999999999e-05 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4519386300000008, 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013544347999999999, 2024-09-17T16:42:39.001 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3200000000000001e-07 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493013+0000", 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00042638399999999998 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493028+0000", 2024-09-17T16:42:39.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4295e-05 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493038+0000", 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0543999999999999e-05 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493139+0000", 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100438 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493149+0000", 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0241000000000001e-05 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506098+0000", 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012948665 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506131+0000", 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3549e-05 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.005 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=106, reqid=client.4553.0:401, at_version=56'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4457775529999992, 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074167790000000001, 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:39.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498749+0000", 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.142e-06 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498887+0000", 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013788200000000001 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498910+0000", 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2765e-05 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498921+0000", 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1112e-05 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.499464+0000", 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054371699999999999 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.499474+0000", 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8980000000000008e-06 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506141+0000", 2024-09-17T16:42:39.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066664640000000004 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506165+0000", 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3799e-05 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=107, reqid=client.4553.0:402, at_version=56'12, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.501419+0000", 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4431064350000007, 2024-09-17T16:42:39.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0054082560000000002, 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501419+0000", 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501419+0000", 2024-09-17T16:42:39.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501420+0000", 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8999999999999995e-07 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501572+0000", 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000152311 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501583+0000", 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1206000000000001e-05 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501591+0000", 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0059999999999992e-06 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.503520+0000", 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019288689999999999 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.503531+0000", 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0975000000000001e-05 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506792+0000", 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003260659 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506827+0000", 2024-09-17T16:42:39.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5439999999999999e-05 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4421025590000003, 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063340460000000003, 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:39.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1699999999999998e-07 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502664+0000", 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00024058 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502676+0000", 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1916000000000001e-05 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502685+0000", 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6410000000000008e-06 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502759+0000", 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4090000000000004e-05 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502772+0000", 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2849e-05 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508727+0000", 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059550530000000001 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508757+0000", 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0300000000000001e-05 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 56/34 ECSubWrite(tid=110, reqid=client.4553.0:406, at_version=56'73, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.509416+0000", 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4351094500000006, 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0060246579999999996, 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509416+0000", 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509416+0000", 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509417+0000", 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9599999999999999e-07 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509661+0000", 2024-09-17T16:42:39.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00024437200000000002 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509675+0000", 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4397e-05 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509684+0000", 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7409999999999998e-06 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509735+0000", 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0723999999999997e-05 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509740+0000", 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.626e-06 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.515420+0000", 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056798609999999996 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.515441+0000", 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0241000000000002e-05 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.493147381, 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085986420000000001, 2024-09-17T16:42:39.024 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0499999999999999e-07 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452396+0000", 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00101738 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452411+0000", 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5406000000000001e-05 2024-09-17T16:42:39.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452420+0000", 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.302e-06 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452496+0000", 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5372999999999998e-05 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452505+0000", 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5750000000000007e-06 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459945+0000", 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074392540000000002 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459977+0000", 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2047e-05 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=62'108, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.4855167539999998, 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088499939999999999, 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.029 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1500000000000004e-07 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459030+0000", 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0313999999999999e-05 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459043+0000", 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3010000000000001e-05 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459050+0000", 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7409999999999992e-06 2024-09-17T16:42:39.031 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459111+0000", 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0671999999999998e-05 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459120+0000", 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467826+0000", 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087057220000000008 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467859+0000", 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2592000000000002e-05 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.036 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:39.036 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:39.036 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.484062931, 2024-09-17T16:42:39.036 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010326251, 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:39.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460463+0000", 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1600000000000001e-07 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460617+0000", 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000153993 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460630+0000", 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2549e-05 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460639+0000", 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0669999999999998e-06 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460779+0000", 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000140159 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460843+0000", 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4352999999999999e-05 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470758+0000", 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0099145610000000006 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470789+0000", 2024-09-17T16:42:39.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0953e-05 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=165, reqid=client.4553.0:474, at_version=62'110, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.465457+0000", 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.479068169, 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055895889999999998, 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.041 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.465457+0000", 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.465457+0000", 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.465458+0000", 2024-09-17T16:42:39.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3600000000000003e-07 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.465515+0000", 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6913000000000002e-05 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.465530+0000", 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5404999999999999e-05 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.465538+0000", 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1089999999999998e-06 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467915+0000", 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023762369999999998 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467924+0000", 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9099999999999994e-06 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.471018+0000", 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0030942949999999999 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.471047+0000", 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8983999999999999e-05 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:39.045 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:39.046 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:39.047 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:39.048 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:39.045+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:39.148 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:39.146+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:39.161 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:39.161 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:39.161 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:39.161 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:39.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:39.250 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:39.248+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:39.273 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:39.273 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:39.273 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:39.273 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:39.273 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:39.282 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:39.350 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:39.348+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.902996192, 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057823329999999997, 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.387 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.388 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481063+0000", 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6600000000000002e-07 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481326+0000", 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026390499999999999 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.389 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481342+0000", 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5136e-05 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481349+0000", 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8469999999999996e-06 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481426+0000", 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6297000000000005e-05 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.390 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481435+0000", 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0289999999999994e-06 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.486818+0000", 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053832089999999999 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.486844+0000", 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6444e-05 2024-09-17T16:42:39.391 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.893425306000001, 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012796989999999999, 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.392 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.393 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3699999999999999e-07 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492041+0000", 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014080290000000001 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492061+0000", 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9678e-05 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492070+0000", 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4050000000000006e-06 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492139+0000", 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8300000000000007e-05 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492148+0000", 2024-09-17T16:42:39.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7049999999999994e-06 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503396+0000", 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011248081 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503430+0000", 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3555e-05 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.886291547999999, 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078697639999999996, 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.397 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:39.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8100000000000002e-07 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497784+0000", 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497795+0000", 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0983e-05 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497803+0000", 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2209999999999997e-06 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497860+0000", 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6886999999999999e-05 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497870+0000", 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0091999999999999e-05 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505602+0000", 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077316379999999999 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505636+0000", 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4677e-05 2024-09-17T16:42:39.401 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.885099563000001, 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069241900000000002, 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4700000000000001e-07 2024-09-17T16:42:39.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499112+0000", 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015267500000000001 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499122+0000", 2024-09-17T16:42:39.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0473e-05 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499130+0000", 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1799999999999999e-06 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499180+0000", 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0114999999999997e-05 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499186+0000", 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5169999999999996e-06 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505852+0000", 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066659800000000002 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505883+0000", 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:42:39.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.884385528999999, 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059870100000000001, 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:42:39.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499973+0000", 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029958099999999999 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499984+0000", 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.08e-05 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499992+0000", 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5210000000000002e-06 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500153+0000", 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016087299999999999 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500161+0000", 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1170000000000004e-06 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505641+0000", 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054796269999999999 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505660+0000", 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8989999999999999e-05 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=16, reqid=client.4553.0:207, at_version=0'0, trim_to=0'0, roll_forward_to=40'13))", 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.873280567999998, 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042977600000000003, 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510778+0000", 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5600000000000005e-07 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510786+0000", 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6890000000000004e-06 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510796+0000", 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8409999999999995e-06 2024-09-17T16:42:39.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510804+0000", 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5450000000000003e-06 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510859+0000", 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4209000000000002e-05 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510869+0000", 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0108999999999999e-05 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515046+0000", 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041771589999999997 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515075+0000", 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9552000000000001e-05 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.416 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 19.872668270999998, 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061959889999999998, 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9900000000000002e-07 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511532+0000", 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014124600000000001 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511545+0000", 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3609e-05 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511555+0000", 2024-09-17T16:42:39.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8220000000000002e-06 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511630+0000", 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4807000000000004e-05 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511649+0000", 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9434000000000001e-05 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517548+0000", 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058984140000000003 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517586+0000", 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8358000000000001e-05 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:42:39.421 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.910514665000001, 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061901810000000003, 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473545+0000", 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474135+0000", 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000589867 2024-09-17T16:42:39.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474152+0000", 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6772000000000001e-05 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474160+0000", 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6670000000000002e-06 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474226+0000", 2024-09-17T16:42:39.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5572000000000002e-05 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474235+0000", 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8529999999999998e-06 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479694+0000", 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054593849999999998 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479734+0000", 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9449000000000001e-05 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=121, reqid=osd.4.0:121, at_version=55'39, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.486331+0000", 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.89772728, 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039609950000000001, 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.426 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486331+0000", 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486331+0000", 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.427 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486331+0000", 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.68e-07 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486355+0000", 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3575999999999999e-05 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486369+0000", 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3971000000000001e-05 2024-09-17T16:42:39.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486379+0000", 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0502e-05 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486476+0000", 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6841000000000003e-05 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486488+0000", 2024-09-17T16:42:39.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2170999999999999e-05 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490245+0000", 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0037569809999999999 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.490292+0000", 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6785e-05 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=123, reqid=osd.4.0:123, at_version=55'41, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.896659155, 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058804240000000004, 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:42:39.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487400+0000", 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8199999999999998e-07 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.432 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487417+0000", 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6994999999999999e-05 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487428+0000", 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1534e-05 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487436+0000", 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7470000000000005e-06 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487487+0000", 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0637999999999999e-05 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487494+0000", 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0199999999999997e-06 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493233+0000", 2024-09-17T16:42:39.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057390399999999999 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493279+0000", 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6567999999999999e-05 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=134, reqid=client.4553.0:379, at_version=55'47, trim_to=0'0, roll_forward_to=55'43))", 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.862867467000001, 2024-09-17T16:42:39.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058772110000000002, 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:42:39.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521192+0000", 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3699999999999999e-07 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521211+0000", 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8970999999999998e-05 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521224+0000", 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3029e-05 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521233+0000", 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3829999999999998e-06 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521288+0000", 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5379e-05 2024-09-17T16:42:39.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521298+0000", 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.527031+0000", 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057332720000000002 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.527068+0000", 2024-09-17T16:42:39.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7110999999999998e-05 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 55/34 ECSubWrite(tid=39, reqid=client.4553.0:386, at_version=55'14, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.786072217999999, 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006518182, 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.440 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9999999999999999e-07 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598219+0000", 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023223800000000001 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598246+0000", 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7399e-05 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598270+0000", 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4323000000000001e-05 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598348+0000", 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7309000000000001e-05 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598364+0000", 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6724000000000001e-05 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604459+0000", 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060950049999999997 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604504+0000", 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4883999999999999e-05 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 55/34 ECSubWrite(tid=40, reqid=client.4553.0:387, at_version=55'15, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.604990+0000", 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.779068017, 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058385690000000001, 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604990+0000", 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604990+0000", 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604991+0000", 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4099999999999997e-07 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605101+0000", 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109597 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605117+0000", 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5922000000000001e-05 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605126+0000", 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9649999999999997e-06 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605218+0000", 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2004999999999997e-05 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605228+0000", 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0108999999999999e-05 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610795+0000", 2024-09-17T16:42:39.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055673820000000001 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610829+0000", 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3648e-05 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 60/34 ECSubWrite(tid=26, reqid=osd.11.0:26, at_version=60'21, trim_to=0'0, roll_forward_to=59'19))", 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.505336+0000", 2024-09-17T16:42:39.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.8787219229999996, 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0041058500000000003, 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505336+0000", 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505336+0000", 2024-09-17T16:42:39.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505337+0000", 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2900000000000004e-07 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505376+0000", 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9359e-05 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505390+0000", 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3759e-05 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505399+0000", 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7220000000000005e-06 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505466+0000", 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7416999999999995e-05 2024-09-17T16:42:39.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.505478+0000", 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2148e-05 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509393+0000", 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003914977 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509442+0000", 2024-09-17T16:42:39.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8939e-05 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 60/34 ECSubWrite(tid=146, reqid=osd.4.0:146, at_version=60'57, trim_to=0'0, roll_forward_to=59'55))", 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.509834+0000", 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.874224517, 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045776590000000004, 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.454 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509834+0000", 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509834+0000", 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509834+0000", 2024-09-17T16:42:39.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8099999999999999e-07 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509855+0000", 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1376e-05 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509868+0000", 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3032e-05 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509876+0000", 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0860000000000002e-06 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509939+0000", 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2570000000000006e-05 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509949+0000", 2024-09-17T16:42:39.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6609999999999995e-06 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514371+0000", 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044222970000000004 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514411+0000", 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0355999999999998e-05 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 61/34 ECSubWrite(tid=59, reqid=osd.13.0:56, at_version=0'0, trim_to=0'0, roll_forward_to=61'23))", 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.525238+0000", 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8588203820000002, 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055593480000000004, 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525238+0000", 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525238+0000", 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525239+0000", 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0729999999999999e-06 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525252+0000", 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3541e-05 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525270+0000", 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7892000000000001e-05 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525280+0000", 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8430000000000005e-06 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525376+0000", 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5731999999999998e-05 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525387+0000", 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0664e-05 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.530755+0000", 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053681559999999998 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.530797+0000", 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2447000000000002e-05 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.463 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 61/34 ECSubWrite(tid=169, reqid=osd.4.0:169, at_version=61'63, trim_to=0'0, roll_forward_to=60'61))", 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8555541880000002, 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051300629999999998, 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:42:39.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1500000000000001e-07 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528528+0000", 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3978999999999999e-05 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528542+0000", 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3879e-05 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528551+0000", 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2080000000000006e-06 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528629+0000", 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7874999999999996e-05 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528643+0000", 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3834e-05 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.533594+0000", 2024-09-17T16:42:39.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049510919999999998 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.533634+0000", 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9981000000000002e-05 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 61/34 ECSubWrite(tid=170, reqid=osd.4.0:170, at_version=61'65, trim_to=0'0, roll_forward_to=60'61))", 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8544378999999998, 2024-09-17T16:42:39.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068917400000000004, 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:42:39.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529621+0000", 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8400000000000004e-07 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529638+0000", 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7316000000000002e-05 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529650+0000", 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1790000000000001e-05 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529656+0000", 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.801e-06 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529702+0000", 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6038999999999997e-05 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529709+0000", 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4919999999999996e-06 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536483+0000", 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067733170000000001 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536512+0000", 2024-09-17T16:42:39.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9300999999999999e-05 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.454090+0000", 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.92996851999999997, 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057171139999999997, 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454090+0000", 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454090+0000", 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454091+0000", 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7290000000000001e-06 2024-09-17T16:42:39.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454337+0000", 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024560899999999999 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454371+0000", 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4428000000000003e-05 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454381+0000", 2024-09-17T16:42:39.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5719999999999992e-06 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454483+0000", 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010149699999999999 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454494+0000", 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1858999999999999e-05 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.459774+0000", 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052791169999999998 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.459807+0000", 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3303000000000003e-05 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.477 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 65/34 ECSubWrite(tid=70, reqid=client.4553.0:502, at_version=65'28, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.462924+0000", 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.921134707, 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046505390000000004, 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462924+0000", 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462924+0000", 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462925+0000", 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1930000000000001e-06 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.463080+0000", 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000154895 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.463096+0000", 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6160000000000001e-05 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.463103+0000", 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.165e-06 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.463192+0000", 2024-09-17T16:42:39.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9519999999999997e-05 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.463206+0000", 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3317e-05 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467530+0000", 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0043240680000000004 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467574+0000", 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4221000000000002e-05 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.482 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:39.483 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:39.484 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:39.481+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:39.525 INFO:tasks.rados.rados.0.smithi183.stdout:200: done (0 left) 2024-09-17T16:42:39.526 INFO:tasks.rados.rados.0.smithi183.stdout:201: snap_create 2024-09-17T16:42:39.584 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:39.582+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:39.588 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:39.588 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:39.588 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:39.588 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:39.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:39.685 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:39.683+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:39.700 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:39.700 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:39.700 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:39.700 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:39.701 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:39.709 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:39.786 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:39.784+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:187 3.cs0 3:385cb74d:::smithi18337221-1:head [copy-from ver 8] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.334282789, 2024-09-17T16:42:39.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.039364976000000003, 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 187 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477631+0000", 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477644+0000", 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2748999999999999e-05 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477673+0000", 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8603e-05 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477688+0000", 2024-09-17T16:42:39.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5454000000000001e-05 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477843+0000", 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015473799999999999 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:42:39.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8953e-05 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480146+0000", 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022843439999999998 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480220+0000", 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3986999999999995e-05 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510626+0000", 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030406048000000001 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515100+0000", 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044740450000000003 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516938+0000", 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001837736 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516994+0000", 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6045000000000003e-05 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.822 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:188 3.cs0 3:385cb74d:::smithi18337221-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.334176816999999, 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.036238998000000001, 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 188 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.823 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477736+0000", 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.494e-06 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477742+0000", 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8930000000000002e-06 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477763+0000", 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0942999999999999e-05 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477781+0000", 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7479999999999999e-05 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019260600000000001 2024-09-17T16:42:39.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477980+0000", 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4829999999999996e-06 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480439+0000", 2024-09-17T16:42:39.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024594259999999998 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480480+0000", 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0512000000000001e-05 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513848+0000", 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033368666999999998 2024-09-17T16:42:39.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513906+0000", 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513974+0000", 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8291000000000001e-05 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:191 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.333983118999999, 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020837920999999999, 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 191 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.831 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.832 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477932+0000", 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2389999999999998e-06 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477939+0000", 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8530000000000003e-06 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477944+0000", 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3279999999999999e-06 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478088+0000", 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014464 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478091+0000", 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6900000000000001e-06 2024-09-17T16:42:39.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482685+0000", 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045939370000000002 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482783+0000", 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8634000000000005e-05 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483160+0000", 2024-09-17T16:42:39.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000376645 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.484086+0000", 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000926092 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498688+0000", 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014601930000000001 2024-09-17T16:42:39.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498767+0000", 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8502000000000002e-05 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:192 3.cs0 3:3e21370b:::smithi18337221-11:head [copy-from ver 6] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:39.837 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.333949149999999, 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028471962999999999, 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 192 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999999e-07 2024-09-17T16:42:39.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477966+0000", 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0769999999999999e-06 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5239999999999997e-06 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477976+0000", 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2399999999999999e-06 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478121+0000", 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145038 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478126+0000", 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4480000000000002e-06 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483386+0000", 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052599209999999999 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483472+0000", 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6159e-05 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492564+0000", 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090913120000000007 2024-09-17T16:42:39.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.501360+0000", 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008796313 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506376+0000", 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050161659999999999 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506435+0000", 2024-09-17T16:42:39.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8354999999999999e-05 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:193 3.cs0 3:3e21370b:::smithi18337221-11:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.333930070000001, 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020602901, 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:39.844 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 193 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:39.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477983+0000", 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3909999999999999e-06 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477992+0000", 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5669999999999995e-06 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477995+0000", 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9119999999999998e-06 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478149+0000", 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153695 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478153+0000", 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5990000000000004e-06 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483619+0000", 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054658809999999997 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483650+0000", 2024-09-17T16:42:39.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1115999999999998e-05 2024-09-17T16:42:39.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498397+0000", 2024-09-17T16:42:39.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014746853000000001 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498485+0000", 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8203999999999998e-05 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9411000000000001e-05 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:266 3.cs0 3:3f892186:::smithi18337221-33:head [create,setxattr Y`URWapPpbRbcVnVY`QSNsZaZVYgbfr]kcmrp_g\\ (35) in=40b,setxattr QSnNfhP`\\rbs^]tkaRf]mXj_]bm_arNTstOQjkpY (1332) in=40b,setxattr YOlbral_g[Tac`rkYhXkaidaYfloWs]f`[kfmoeq (1402) in=40b,setxattr O\\Up[arf_O^_OTehidgQm\\_dWqiOgZeddoq[Yeim (421) in=40b,setxattr OliOVUW (1227) in=7b,setxattr mRZhPnOqZXai[tb[_iYpr_fWU`VpVZePspesWXth (9612) in=40b,setxattr p`]Nq_ParoVlgZ_RfOmdYljgitUhq[nn^STkQnm\\ (489) in=40b,setxattr gac_OaSTa[cilYpd\\TYRomd[_[t]lkbeSfUstbbO (385) in=40b,setxattr [^knka[\\][o`oZ[XWVa\\nRZ_^]h[\\ZPq`fqVZUm` (13472) in=40b,setxattr paYr[ki]Uj^gZYZXoSk]OhhpsdnXbWSQNQUhgNgp (1649) in=40b,setxattr SXYNfcNts[adfhlcih^SbYXacRgpdjjt_UedQoso (1789) in=40b,setxattr SsZS^dPc\\fk]ZQjgZ[i]iageNpNcccY^_QpkmcZR (1121) in=40b,setxattr cbOj`RWijYOTWkn\\Sk\\N_a[otcWhlc_kPXhaQhtm (1402) in=40b,setxattr fddhrQT_f\\R (1227) in=11b,setxattr jffqjeh^Weeqcg^`^Wa]]on^og\\VRjnkZqT\\oRWq (243) in=40b,setxattr i[eniSaVsaY_koZilr\\[qpYgN_PenNUPlN\\hNr]Z (1929) in=40b,setxattr Sbtooedescb]TlUVZR^hh[icrap_aWR^_mTZalnt (1963) in=40b,setxattr iYtRdsiUT^YaZcYqmPkOTbnaa_c^ (1227) in=28b,setxattr ao`Z_^XlrOjfeg]XV`]_[il^OU]]def]hmcaTagQ (349) in=40b,setxattr gg]bVkQeTo]\\ji^ph[UbnhXh_aaWYaTU_mQp`lPf (3576) in=40b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.301306481000001, 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018237339000000002, 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 266 2024-09-17T16:42:39.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510606+0000", 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5099999999999998e-07 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510781+0000", 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174525 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510796+0000", 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5435999999999999e-05 2024-09-17T16:42:39.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510804+0000", 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3969999999999997e-06 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510859+0000", 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5102999999999997e-05 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:39.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510863+0000", 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3959999999999999e-06 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.516079+0000", 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052157760000000001 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.516181+0000", 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101841 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517216+0000", 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010352790000000001 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.518703+0000", 2024-09-17T16:42:39.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014866829999999999 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528773+0000", 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010070608999999999 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528843+0000", 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9443000000000006e-05 2024-09-17T16:42:39.860 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:362 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~491520] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.497212+0000", 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.314700257, 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017300221000000001, 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.861 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 362 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497212+0000", 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497212+0000", 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497214+0000", 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0389999999999999e-06 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497773+0000", 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00055930400000000005 2024-09-17T16:42:39.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497788+0000", 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5338000000000001e-05 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497797+0000", 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.303e-06 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497864+0000", 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7650000000000005e-05 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.497945+0000", 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0926000000000004e-05 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.498805+0000", 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000859423 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.511457+0000", 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012652682 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514458+0000", 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030005029999999999 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514512+0000", 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4052999999999999e-05 2024-09-17T16:42:39.866 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:400 3.5s0 3:a48bc8c8:::smithi18337221-49:head [append 0~573440] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.490194+0000", 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.321718273, 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016574993, 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.867 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 400 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.490194+0000", 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.490194+0000", 2024-09-17T16:42:39.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.490196+0000", 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9560000000000002e-06 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491001+0000", 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00080424700000000001 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491017+0000", 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6269e-05 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491045+0000", 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7888000000000001e-05 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491112+0000", 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7385999999999995e-05 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.491198+0000", 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5674999999999995e-05 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492356+0000", 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011577639999999999 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506268+0000", 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013912143 2024-09-17T16:42:39.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506589+0000", 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000320728 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506769+0000", 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000179937 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:401 3.5s0 3:a48bc8c8:::smithi18337221-49:head [append 0~425984] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492593+0000", 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.319319262, 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014356555, 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 401 2024-09-17T16:42:39.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492593+0000", 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492593+0000", 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492594+0000", 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4950000000000001e-06 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.493125+0000", 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053070400000000001 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.493142+0000", 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7169000000000001e-05 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.493152+0000", 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6520000000000001e-06 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.496453+0000", 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033016299999999998 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.496538+0000", 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5179999999999994e-05 2024-09-17T16:42:39.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.497382+0000", 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084374799999999996 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506273+0000", 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088910970000000006 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506861+0000", 2024-09-17T16:42:39.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000587753 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506949+0000", 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8127000000000005e-05 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:402 3.5s0 3:a48bc8c8:::smithi18337221-49:head [append 0~344064] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494475+0000", 2024-09-17T16:42:39.878 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.317436361, 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014544682999999999, 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 402 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494475+0000", 2024-09-17T16:42:39.879 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494475+0000", 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494477+0000", 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3349999999999999e-06 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494812+0000", 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033566500000000002 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494827+0000", 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4827999999999999e-05 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494834+0000", 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7819999999999996e-06 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500331+0000", 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054966019999999997 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500429+0000", 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7842000000000003e-05 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.501127+0000", 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069878699999999998 2024-09-17T16:42:39.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506371+0000", 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052436050000000001 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.508945+0000", 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025742769999999998 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.509020+0000", 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4960000000000001e-05 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:403 3.5s0 3:a48bc8c8:::smithi18337221-49:head [setxattr _header (57) in=7b] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.317061971999999, 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016737051999999999, 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 403 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494850+0000", 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9999999999999997e-07 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494853+0000", 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8660000000000002e-06 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494859+0000", 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8239999999999996e-06 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494863+0000", 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6509999999999999e-06 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505091+0000", 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010228671999999999 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505201+0000", 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109677 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.505801+0000", 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00059984700000000003 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506786+0000", 2024-09-17T16:42:39.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098517299999999999 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.511487+0000", 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047005040000000003 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.511587+0000", 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100238 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:404 3.5s0 3:a48bc8c8:::smithi18337221-49:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.317043025, 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017980659999999999, 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 404 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.890 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:42:39.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9400000000000001e-07 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494871+0000", 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5069999999999999e-06 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494876+0000", 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2689999999999999e-06 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494879+0000", 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1499999999999999e-06 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.893 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506094+0000", 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011215163 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506241+0000", 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014708899999999999 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512022+0000", 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057804579999999996 2024-09-17T16:42:39.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512109+0000", 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6910999999999995e-05 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512849+0000", 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074081899999999998 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:405 3.cs0 3:385cb74d:::smithi18337221-1:head [append 0~589824] snapc d=[d,c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.500132+0000", 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.311779803, 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015556489, 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 405 2024-09-17T16:42:39.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500132+0000", 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500132+0000", 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500134+0000", 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5659999999999999e-06 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500796+0000", 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00066278300000000001 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500808+0000", 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1772e-05 2024-09-17T16:42:39.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500815+0000", 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3050000000000004e-06 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500875+0000", 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9521000000000002e-05 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500974+0000", 2024-09-17T16:42:39.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8547000000000004e-05 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.502145+0000", 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011713590000000001 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512582+0000", 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010437428 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.515610+0000", 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0030276349999999999 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.515688+0000", 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8572999999999995e-05 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:426 3.cs0 3:3f892186:::smithi18337221-33:head [read 691106~996446,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.503877+0000", 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3080352130000001, 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017332423999999999, 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.902 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 426 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503877+0000", 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503877+0000", 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503878+0000", 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4139999999999999e-06 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503967+0000", 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9321999999999996e-05 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503981+0000", 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3213999999999999e-05 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503991+0000", 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0648999999999999e-05 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508412+0000", 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044207739999999997 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508512+0000", 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100159 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.521209+0000", 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012696892 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.906 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:427 3.cs0 3:3f892186:::smithi18337221-33:head [read 1683278~4274,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3079021339999999, 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017439217999999999, 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 427 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4199999999999996e-07 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504014+0000", 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7950000000000001e-06 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504022+0000", 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7729999999999999e-06 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504028+0000", 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0820000000000004e-06 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511835+0000", 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078073700000000001 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511962+0000", 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126792 2024-09-17T16:42:39.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.521449+0000", 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094868639999999994 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:428 3.cs0 3:3f892186:::smithi18337221-33:head [read 0~1687552,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.307875449, 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019143165, 2024-09-17T16:42:39.911 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 428 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.912 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504037+0000", 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0500000000000004e-07 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.913 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504046+0000", 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6400000000000003e-06 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504053+0000", 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3730000000000004e-06 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504058+0000", 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2970000000000003e-06 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.914 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512478+0000", 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084197920000000006 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512531+0000", 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3173000000000001e-05 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.523180+0000", 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010648385 2024-09-17T16:42:39.915 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:430 3.5s0 3:aa61f2ff:::smithi18337221-5:head [rollback 8] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504111+0000", 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3078009919999998, 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013761542, 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.916 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 430 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504111+0000", 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504111+0000", 2024-09-17T16:42:39.917 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504111+0000", 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504114+0000", 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6079999999999998e-06 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.918 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504121+0000", 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3880000000000002e-06 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504127+0000", 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2630000000000003e-06 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508644+0000", 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045171839999999996 2024-09-17T16:42:39.919 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508734+0000", 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9810999999999998e-05 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510036+0000", 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001302187 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.515349+0000", 2024-09-17T16:42:39.920 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053134799999999998 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.517801+0000", 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024519310000000001 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.517872+0000", 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1137999999999996e-05 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.921 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:431 3.5s0 3:aa61f2ff:::smithi18337221-5:head [append 0~0] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504133+0000", 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3077783390000004, 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013967446999999999, 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 431 2024-09-17T16:42:39.922 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504133+0000", 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504133+0000", 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.923 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504134+0000", 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504136+0000", 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.911e-06 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504142+0000", 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8449999999999999e-06 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.924 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504146+0000", 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8099999999999997e-06 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510786+0000", 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066395009999999999 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510907+0000", 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012087999999999999 2024-09-17T16:42:39.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511403+0000", 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049630799999999999 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.517393+0000", 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005990179 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.926 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518009+0000", 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00061586599999999996 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518101+0000", 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1687999999999994e-05 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:432 3.cs0 3:388a95d9:::smithi18337221-23:head [create,setxattr nWX_d[W\\dXUWOgbXndrSbcTU`mgjR_]o\\nNcXpin (1403) in=40b,setxattr TSP[ddnm_WR]nh]QhSXpkpmmWeOP^b]baemT^Uqr (630) in=40b,setxattr R[QU^NWYrjfarmhlWmZlUkP\\ipWan`SnqZOX`VWh (806) in=40b,setxattr ]hV\\^[PQZO]n^abhilRfldoUhgtl\\\\oel`mgahd_ (3368) in=40b,setxattr OYc`XQ\\VjZfQ`]OsbemUo_mfVUSc^pNo\\[\\ldrhg (1087) in=40b,setxattr `pZtTmno_eqZOONfatgZ_`nnhemaaQWiteO]dc[V (175) in=40b,setxattr PdQa`feQapkrnjfOUYUeqsOt_hrsg\\noqrcV]pSh (981) in=40b,setxattr bk_QpaSsdlQfT`oa[pTQS_[ad]isfYm^tQNdhSiW (1718) in=40b,setxattr Ys`Y_UZ^PXhpgS`VS]`eVgkcmT^QW[aWscssRRSr (10033) in=40b,setxattr [jd]Q\\qemWTVcc`hiZnsrqrggetajZRa]\\_llS`h (1367) in=40b,setxattr `UajoeZh]tRSf\\[nnVat^TjN^_q`ooQ_br`itgZm (244) in=40b,setxattr Tng[WcWa_dsnRXtZNa^`fle`gQ___mar\\fgRsZVY (665) in=40b,setxattr nogmhepVZfQtnZc^cZSeaaogjklZkrff_Utg`UR^ (15856) in=40b,setxattr gfqSsQY[][rrac[gmaQrTSacNWttTTXhanmRa^fa (1998) in=40b,setxattr V`Y[ddb`_dfep[_]oUoTqQj\\UW[gkesnlgNPYtPa (1438) in=40b,setxattr YgoRVqUOj_mXPXsq^PdjaaolmQsTsTsZpaddktl[ (1400) in=40b,setxattr smn[QVPVkfVs]oTip]jtirOtU\\Pa\\Ym^poZgfZaq (1263) in=40b,setxattr TQSmSs^Z]\\rdosO_a^TOU^[p`jkQb`dXXh]s`Stq (909) in=40b,setxattr faPhpqVXmWh`VeNZo[b^[kYl^[[rYYPRrk_[ON`e (14664) in=40b,setxattr ksO_UmqqQefe[Q\\njt[W_roWeei`]Sn^TV]O^iSW (1963) in=40b] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:39.927 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.510841+0000", 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.3010707119999996, 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013503129000000001, 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 432 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.928 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510841+0000", 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510841+0000", 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510843+0000", 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.604e-06 2024-09-17T16:42:39.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511293+0000", 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000450631 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511305+0000", 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1962e-05 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511312+0000", 2024-09-17T16:42:39.930 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0609999999999998e-06 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512726+0000", 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001414032 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512842+0000", 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000115388 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.931 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.513819+0000", 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00097731100000000002 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.521696+0000", 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078768769999999991 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.524244+0000", 2024-09-17T16:42:39.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002548303 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.524344+0000", 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9959999999999998e-05 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:467 3.cs0 3:3c017d1f:::smithi18337221-45:head [stat,delete] snapc e=[e,b] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.508695+0000", 2024-09-17T16:42:39.933 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.3032169959999997, 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014303152, 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 467 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:39.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.508695+0000", 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.508695+0000", 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.508696+0000", 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.46e-06 2024-09-17T16:42:39.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.508708+0000", 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1836e-05 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.508727+0000", 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8410000000000002e-05 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.508735+0000", 2024-09-17T16:42:39.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8130000000000002e-06 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.510930+0000", 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0021950759999999998 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.511047+0000", 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011675699999999999 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.937 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.511819+0000", 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077172700000000005 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.515350+0000", 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035312389999999998 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.522941+0000", 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075905060000000003 2024-09-17T16:42:39.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.522998+0000", 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7327999999999997e-05 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:39.939 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:39.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:39.942 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:39.939+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:40.041 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:40.039+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:40.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:40.044 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:40.044 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:40.045 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:40.045 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:40.056 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:40.142 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:40.140+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:40.158 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:40.158 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:40.159 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:40.159 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:40.159 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:40.167 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:40.243 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:40.241+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:40.272 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:40.272 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.771244924000001, 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048787229999999997, 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498547+0000", 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498548+0000", 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6599999999999996e-07 2024-09-17T16:42:40.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498566+0000", 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7934000000000001e-05 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498578+0000", 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1769e-05 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498583+0000", 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7769999999999999e-06 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498647+0000", 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3689000000000006e-05 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498657+0000", 2024-09-17T16:42:40.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3740000000000004e-06 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503393+0000", 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004736428 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503426+0000", 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3086000000000001e-05 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 26.769504782999999, 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091284039999999997, 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500288+0000", 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8799999999999998e-07 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500609+0000", 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000321482 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500624+0000", 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4558e-05 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500632+0000", 2024-09-17T16:42:40.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500693+0000", 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1045999999999998e-05 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500703+0000", 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9899999999999992e-06 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509375+0000", 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086724420000000007 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509416+0000", 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0639000000000002e-05 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:40.282 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.747032439000002, 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010249355999999999, 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:40.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2e-07 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523388+0000", 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062798599999999997 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523412+0000", 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3898999999999999e-05 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523422+0000", 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0259e-05 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523489+0000", 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7070000000000007e-05 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523500+0000", 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0617e-05 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532963+0000", 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009463183 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533009+0000", 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5921999999999998e-05 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.286 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=20, reqid=client.4553.0:271, at_version=46'13, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.741708764999998, 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053659780000000004, 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528084+0000", 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:42:40.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228254 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528326+0000", 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.366e-05 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528334+0000", 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3000000000000002e-06 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529561+0000", 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226293 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529570+0000", 2024-09-17T16:42:40.290 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5820000000000008e-06 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533417+0000", 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003846576 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533449+0000", 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2694000000000002e-05 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.291 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.784660859999999, 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081612969999999996, 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485132+0000", 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5699999999999999e-07 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.293 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485905+0000", 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077313100000000004 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485917+0000", 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2092999999999999e-05 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485924+0000", 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7700000000000004e-06 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485987+0000", 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3487999999999999e-05 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485998+0000", 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0917000000000001e-05 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493262+0000", 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072639489999999996 2024-09-17T16:42:40.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493293+0000", 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0791999999999999e-05 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:40.296 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.755048675999999, 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014931335, 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.99e-07 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515242+0000", 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049758300000000001 2024-09-17T16:42:40.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515257+0000", 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.502e-05 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515265+0000", 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515335+0000", 2024-09-17T16:42:40.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9536000000000006e-05 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515345+0000", 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9240000000000002e-06 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529639+0000", 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014294526 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529675+0000", 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.748027522999999, 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081458920000000001, 2024-09-17T16:42:40.301 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:40.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521766+0000", 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5700000000000001e-07 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522010+0000", 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024482600000000002 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522025+0000", 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.484e-05 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522035+0000", 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000001e-06 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522101+0000", 2024-09-17T16:42:40.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5848999999999999e-05 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522111+0000", 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0122000000000001e-05 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529879+0000", 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077677559999999998 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.305 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529911+0000", 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=29, reqid=client.4553.0:374, at_version=55'23, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.526115+0000", 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.743677187999999, 2024-09-17T16:42:40.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040460779999999998, 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526115+0000", 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526115+0000", 2024-09-17T16:42:40.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526116+0000", 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4099999999999998e-07 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526232+0000", 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000116276 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526243+0000", 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.046e-05 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526248+0000", 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7250000000000002e-06 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526736+0000", 2024-09-17T16:42:40.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048768100000000001 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.526748+0000", 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1558e-05 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.530125+0000", 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0033771270000000002 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.530161+0000", 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6510000000000001e-05 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.663162289000001, 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048852510000000002, 2024-09-17T16:42:40.311 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606632+0000", 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.547e-06 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607055+0000", 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042362999999999998 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607075+0000", 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0128000000000001e-05 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607086+0000", 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0705e-05 2024-09-17T16:42:40.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607170+0000", 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4061999999999996e-05 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607181+0000", 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1430000000000001e-05 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611472+0000", 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042906589999999996 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611515+0000", 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.658395999, 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008221562, 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:40.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611397+0000", 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.71e-07 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611941+0000", 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000544269 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611963+0000", 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1710999999999999e-05 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611973+0000", 2024-09-17T16:42:40.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612053+0000", 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0012999999999994e-05 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612087+0000", 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4171999999999997e-05 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619590+0000", 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075029110000000001 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619618+0000", 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7461999999999999e-05 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=35, reqid=client.4553.0:396, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.651324315, 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062462430000000003, 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618469+0000", 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618513+0000", 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618529+0000", 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6183000000000001e-05 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618538+0000", 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618616+0000", 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8300999999999995e-05 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618627+0000", 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0750999999999999e-05 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624677+0000", 2024-09-17T16:42:40.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060503570000000001 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624714+0000", 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6786999999999999e-05 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=36, reqid=client.4553.0:397, at_version=55'29, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:40.326 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.649465706999999, 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004607384, 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620327+0000", 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2499999999999995e-07 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620342+0000", 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4865000000000001e-05 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620357+0000", 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5098e-05 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620366+0000", 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4889999999999995e-06 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620411+0000", 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5411000000000003e-05 2024-09-17T16:42:40.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.620416+0000", 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3190000000000002e-06 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624906+0000", 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044902270000000003 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624934+0000", 2024-09-17T16:42:40.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.745e-05 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.777335931, 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079871060000000008, 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492457+0000", 2024-09-17T16:42:40.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-07 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492641+0000", 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184215 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492656+0000", 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279000000000001e-05 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492704+0000", 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7738000000000003e-05 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492882+0000", 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177906 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492916+0000", 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4110999999999999e-05 2024-09-17T16:42:40.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500404+0000", 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074877750000000003 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500443+0000", 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9724000000000001e-05 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 60/34 ECSubWrite(tid=51, reqid=osd.15.0:51, at_version=60'32, trim_to=0'0, roll_forward_to=59'30))", 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.7608899229999997, 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005118587, 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:42:40.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508903+0000", 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-07 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508925+0000", 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2251000000000001e-05 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508934+0000", 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8240000000000006e-06 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508941+0000", 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7579999999999992e-06 2024-09-17T16:42:40.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508998+0000", 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6230999999999997e-05 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509007+0000", 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4879999999999996e-06 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.513970+0000", 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049629039999999998 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514021+0000", 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0841999999999999e-05 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 60/34 ECSubWrite(tid=134, reqid=client.4553.0:430, at_version=60'22, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:40.340 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.7598175720000002, 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049015120000000002, 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:40.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509994+0000", 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8853000000000001e-05 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510005+0000", 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0658e-05 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510012+0000", 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4950000000000002e-06 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510068+0000", 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5566999999999998e-05 2024-09-17T16:42:40.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510077+0000", 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1349999999999998e-06 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514842+0000", 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047653260000000003 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514876+0000", 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3782000000000003e-05 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.345 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.6801572179999997, 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099594590000000004, 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589636+0000", 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.124e-06 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590162+0000", 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052565200000000004 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590177+0000", 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5627000000000001e-05 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590187+0000", 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4439999999999997e-06 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590255+0000", 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7867000000000006e-05 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590264+0000", 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0799999999999995e-06 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599543+0000", 2024-09-17T16:42:40.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009279374 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599595+0000", 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1291000000000001e-05 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:42:40.350 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.6754722920000003, 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065491719999999998, 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594321+0000", 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000005e-07 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594830+0000", 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050941699999999996 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594845+0000", 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4535999999999999e-05 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594855+0000", 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0344e-05 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595268+0000", 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041257099999999998 2024-09-17T16:42:40.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595278+0000", 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.048e-05 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600836+0000", 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055574250000000004 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600869+0000", 2024-09-17T16:42:40.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3408999999999998e-05 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 61/34 ECSubWrite(tid=56, reqid=osd.0.0:55, at_version=0'0, trim_to=0'0, roll_forward_to=61'49))", 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.525827+0000", 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.7439656699999997, 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048540459999999999, 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.355 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525827+0000", 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525827+0000", 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525827+0000", 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5199999999999996e-07 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525838+0000", 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0910999999999999e-05 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525854+0000", 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5696999999999999e-05 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525863+0000", 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4779999999999997e-06 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525938+0000", 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.5061000000000005e-05 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525949+0000", 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0528e-05 2024-09-17T16:42:40.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.530633+0000", 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046839289999999999 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.530681+0000", 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7689999999999999e-05 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 62/34 ECSubWrite(tid=57, reqid=osd.0.0:57, at_version=62'51, trim_to=0'0, roll_forward_to=61'49))", 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.443009+0000", 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8267837230000001, 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040317419999999996, 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443009+0000", 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443009+0000", 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443009+0000", 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5599999999999999e-07 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443027+0000", 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8337000000000001e-05 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443039+0000", 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1917e-05 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443049+0000", 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0239e-05 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443112+0000", 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2640999999999999e-05 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443122+0000", 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0438999999999999e-05 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.446997+0000", 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038751390000000001 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.447040+0000", 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2874000000000003e-05 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 62/34 ECSubWrite(tid=58, reqid=osd.0.0:58, at_version=62'53, trim_to=0'0, roll_forward_to=61'49))", 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.8261948559999999, 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067202670000000003, 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:42:40.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443598+0000", 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443624+0000", 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5219999999999999e-05 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443638+0000", 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4470999999999999e-05 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443647+0000", 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4199999999999996e-06 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444249+0000", 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060141600000000002 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444255+0000", 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4080000000000003e-06 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450282+0000", 2024-09-17T16:42:40.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060268819999999999 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450318+0000", 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5553000000000003e-05 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:40.369 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:40.371 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:40.368+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:40.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:40.383 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:40.383 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:40.401 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:40.401 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:40.420 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:40.420 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:40.437 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:40.438 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:40.441 INFO:tasks.rados.rados.0.smithi183.stdout:201: done (0 left) 2024-09-17T16:42:40.441 INFO:tasks.rados.rados.0.smithi183.stdout:202: rollback oid 34 current snap is 17 2024-09-17T16:42:40.441 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 34 to 13 2024-09-17T16:42:40.441 INFO:tasks.rados.rados.0.smithi183.stdout:203: snap_remove snap 15 2024-09-17T16:42:40.457 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:40.458 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:40.471 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:40.469+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:40.474 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:40.474 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:40.478 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:40.478 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:40.479 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:40.479 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:40.487 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:40.491 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:40.492 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:40.509 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:40.509 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:40.525 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:40.525 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:40.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:42:40.542 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:40.542 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:40.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:40.560 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:40.571 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:40.569+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:40.577 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:40.578 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:40.591 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:40.591 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:40.591 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:40.591 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:40.591 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:40.594 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:40.595 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:40.600 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:40.612 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:40.612 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:40.629 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:40.629 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:40.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:40.628+0000 7f14e28da640 0 -- 172.21.15.60:0/3030647548 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f14dc2240c0 msgr2=0x7f14dc2264b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:40.674 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:40.671+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:40.704 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:40.704 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:40.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:40.775 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:40.773+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:40.825 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:40.825 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:40.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:40.857 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:40.857 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:40.909 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:40.907+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:40.938 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:40.938 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:40.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:40.991 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:40.989+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.049 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.057 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:41.079 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:41.077+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:41.180 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:41.178+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:41.201 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.201 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:41.285 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:41.279+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:41.311 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.312 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.320 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:41.382 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:41.380+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:41.438 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:42:41.442 INFO:tasks.rados.rados.0.smithi183.stdout:203: done (1 left) 2024-09-17T16:42:41.442 INFO:tasks.rados.rados.0.smithi183.stdout:204: delete oid 41 current snap is 17 2024-09-17T16:42:41.442 INFO:tasks.rados.rados.0.smithi183.stdout:202: finishing rollback tid 0 to smithi18337221-34 2024-09-17T16:42:41.443 INFO:tasks.rados.rados.0.smithi183.stdout:202: finishing rollback tid 1 to smithi18337221-34 2024-09-17T16:42:41.443 INFO:tasks.rados.rados.0.smithi183.stdout:202: finishing rollback tid 2 to smithi18337221-34 2024-09-17T16:42:41.443 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 34 v 67 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-09-17T16:42:41.450 INFO:tasks.rados.rados.0.smithi183.stdout:202: done (1 left) 2024-09-17T16:42:41.450 INFO:tasks.rados.rados.0.smithi183.stdout:204: done (0 left) 2024-09-17T16:42:41.450 INFO:tasks.rados.rados.0.smithi183.stdout:205: rollback oid 44 current snap is 17 2024-09-17T16:42:41.451 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 44 to 14 2024-09-17T16:42:41.451 INFO:tasks.rados.rados.0.smithi183.stdout:206: read oid 11 snap -1 2024-09-17T16:42:41.451 INFO:tasks.rados.rados.0.smithi183.stdout:206: expect (ObjNum 62 snap 6 seq_num 62) 2024-09-17T16:42:41.451 INFO:tasks.rados.rados.0.smithi183.stdout:207: snap_create 2024-09-17T16:42:41.456 INFO:tasks.rados.rados.0.smithi183.stdout:205: finishing rollback tid 0 to smithi18337221-44 2024-09-17T16:42:41.459 INFO:tasks.rados.rados.0.smithi183.stdout:205: finishing rollback tid 1 to smithi18337221-44 2024-09-17T16:42:41.459 INFO:tasks.rados.rados.0.smithi183.stdout:205: finishing rollback tid 2 to smithi18337221-44 2024-09-17T16:42:41.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 44 v 34 (ObjNum 52 snap 0 seq_num 52) dirty exists 2024-09-17T16:42:41.463 INFO:tasks.rados.rados.0.smithi183.stdout:206: expect (ObjNum 62 snap 6 seq_num 62) 2024-09-17T16:42:41.463 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 81446 2024-09-17T16:42:41.467 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.467 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.476 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:41.487 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1278460 2024-09-17T16:42:41.490 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:41.521 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:41.519+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:41.582 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.582 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.583 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:41.581+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:41.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:41.684 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:41.682+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:41.733 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.733 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.741 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:41.785 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:41.783+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:41.843 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.843 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.851 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:41.896 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:41.894+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:41.954 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:41.954 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:41.963 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:41.987 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:41.985+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:42.088 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:42.086+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:42.105 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.105 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.113 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:42.189 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:42.187+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:42.216 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.216 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.225 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:42.291 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:42.289+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:42.340 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.340 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.349 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:42.391 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:42.389+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:42.445 INFO:tasks.rados.rados.0.smithi183.stdout:205: done (2 left) 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:206: done (1 left) 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:207: done (0 left) 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:208: read oid 4 snap -1 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:208: expect (ObjNum 56 snap 3 seq_num 56) 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:209: rmattr oid 24 current snap is 18 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:209: done (1 left) 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:210: setattr oid 26 current snap is 18 2024-09-17T16:42:42.446 INFO:tasks.rados.rados.0.smithi183.stdout:211: setattr oid 21 current snap is 18 2024-09-17T16:42:42.447 INFO:tasks.rados.rados.0.smithi183.stdout:212: setattr oid 50 current snap is 18 2024-09-17T16:42:42.448 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 23 current snap is 18 2024-09-17T16:42:42.448 INFO:tasks.rados.rados.0.smithi183.stdout:213: seq_num 93 ranges {376832=802816,1179648=638976,1818624=131072} 2024-09-17T16:42:42.454 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:42.454 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:42.454 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T16:42:42.454 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T16:42:42.455 INFO:tasks.rados.rados.0.smithi183.stdout:213: writing smithi18337221-23 from 376832 to 1179648 tid 1 2024-09-17T16:42:42.457 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.457 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.458 INFO:tasks.rados.rados.0.smithi183.stdout:213: writing smithi18337221-23 from 1179648 to 1818624 tid 2 2024-09-17T16:42:42.460 INFO:tasks.rados.rados.0.smithi183.stdout:213: writing smithi18337221-23 from 1818624 to 1949696 tid 3 2024-09-17T16:42:42.460 INFO:tasks.rados.rados.0.smithi183.stdout:214: read oid 31 snap -1 2024-09-17T16:42:42.460 INFO:tasks.rados.rados.0.smithi183.stdout:214: expect deleted 2024-09-17T16:42:42.460 INFO:tasks.rados.rados.0.smithi183.stdout:215: snap_remove snap 16 2024-09-17T16:42:42.468 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:42.492 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:42.490+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:42.571 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.571 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.580 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:42.593 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:42.591+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:42.683 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.683 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.692 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:42.693 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:42.691+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:42.767 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:42.767 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 69, 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "a18a1a02-ea8d-4573-a275-cb30a154e84c", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2024-09-17T16:41:30.645147+0000", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2024-09-17T16:42:42.437337+0000", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2024-09-17T16:41:45.664856+0000", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2024-09-17T16:41:34.797369+0000", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5801984, 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "noscrub", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2024-09-17T16:42:42.768 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 7, 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 3, 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 16, 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "luminous", 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "squid", 2024-09-17T16:42:42.769 INFO:teuthology.orchestra.run.smithi060.stdout: "allow_crimson": false, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": ".mgr", 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2024-09-17T16:41:43.059025+0000", 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2024-09-17T16:42:42.770 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "is_stretch_pool": false, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2024-09-17T16:42:42.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "25", 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2024-09-17T16:42:42.772 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T16:42:42.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T16:42:42.774 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_max": 32, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": {} 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "read_balance": { 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "score_type": "Fair distribution", 2024-09-17T16:42:42.775 INFO:teuthology.orchestra.run.smithi060.stdout: "score_acting": 15.380000114440918, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "score_stable": 15.380000114440918, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_acting": 2, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_stable": 2, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity_weighted": 1, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity": 1, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity_weighted": 1 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2024-09-17T16:42:42.776 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2024-09-17T16:41:53.164635+0000", 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 8193, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "is_stretch_pool": false, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2024-09-17T16:42:42.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "30", 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 2, 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 30, 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2024-09-17T16:42:42.779 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2024-09-17T16:42:42.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2024-09-17T16:42:42.781 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "read_balance": { 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "score_type": "Fair distribution", 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "score_acting": 3.9900000095367432, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "score_stable": 3.9900000095367432, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "optimal_score": 0.68999999761581421, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_acting": 2.75, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "raw_score_stable": 2.75, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity_weighted": 1, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity": 1, 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: "average_primary_affinity_weighted": 1 2024-09-17T16:42:42.782 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "unique_pool_0", 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2024-09-17T16:42:06.437635+0000", 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 8193, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 3, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 7, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 5, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 1, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_count": 0, 2024-09-17T16:42:42.783 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_target": 0, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "is_stretch_pool": false, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 16, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 16, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 16, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 16, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 16, 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2024-09-17T16:42:42.784 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "69", 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2024-09-17T16:42:42.785 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 19, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 69, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2024-09-17T16:42:42.786 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "shecprofile", 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2024-09-17T16:42:42.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 16384, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "rados": {} 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:42.788 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "c580007f-04f5-4607-bcb0-9eca9fb6a273", 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.789 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2024-09-17T16:42:42.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2024-09-17T16:42:42.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 360852295 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6817/360852295", 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6819/360852295", 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6823/360852295", 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6821/360852295", 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "5068e4a5-399f-472d-bf4d-0105adfba800", 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.795 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6824", 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6825", 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6826", 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6827", 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6830", 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6831", 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6828", 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6829", 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2001248690 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6825/2001248690", 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6827/2001248690", 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6831/2001248690", 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6829/2001248690", 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2024-09-17T16:42:42.800 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d", 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6808", 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6809", 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6810", 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6811", 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6814", 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6815", 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6812", 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6813", 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1107977430 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6809/1107977430", 2024-09-17T16:42:42.805 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6811/1107977430", 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6815/1107977430", 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6813/1107977430", 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "e00f6dc3-b74d-441a-abff-55ed4fba87a1", 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.806 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6826", 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6827", 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6828", 2024-09-17T16:42:42.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6829", 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6832", 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6833", 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6830", 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6831", 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3360497893 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6827/3360497893", 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6829/3360497893", 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6833/3360497893", 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6831/3360497893", 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "7d0041d5-389e-4b11-b8e1-535c6113a4f7", 2024-09-17T16:42:42.812 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.813 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2024-09-17T16:42:42.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3686363495 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6825/3686363495", 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6827/3686363495", 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6831/3686363495", 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6829/3686363495", 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "9fc5ba03-7465-43f6-a148-fcecb32304a7", 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 23, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.819 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6800", 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6801", 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6802", 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6803", 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6806", 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6807", 2024-09-17T16:42:42.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6804", 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6805", 2024-09-17T16:42:42.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3943188618 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6801/3943188618", 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6803/3943188618", 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6807/3943188618", 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6805/3943188618", 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f2be94b-f485-485b-9d16-80f293b0274c", 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 27, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.825 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6800", 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6801", 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6802", 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6803", 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.827 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6806", 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6807", 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6804", 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6805", 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2604225407 2024-09-17T16:42:42.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6801/2604225407", 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6803/2604225407", 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6807/2604225407", 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6805/2604225407", 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2024-09-17T16:42:42.830 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eedf3336-c9e3-4c8c-b81a-2f0ebfad326c", 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6818", 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6819", 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6820", 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6821", 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.833 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6824", 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6825", 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6822", 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6823", 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 462795917 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6819/462795917", 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6821/462795917", 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6825/462795917", 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6823/462795917", 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 8, 2024-09-17T16:42:42.836 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "44e1f674-128a-4388-a488-ffdec5ab479a", 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 21, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6800", 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6801", 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.840 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 680830956 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6801/680830956", 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6803/680830956", 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6807/680830956", 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6805/680830956", 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 9, 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "c085e6d8-5929-4ab1-826e-cecb51ed73cd", 2024-09-17T16:42:42.842 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 21, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 27, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6808", 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6809", 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6810", 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6811", 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6814", 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6815", 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6812", 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6813", 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2482839491 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6809/2482839491", 2024-09-17T16:42:42.847 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6811/2482839491", 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6815/2482839491", 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6813/2482839491", 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 10, 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "87248b6a-e219-48a5-911c-4995588e51a2", 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.848 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6816", 2024-09-17T16:42:42.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6817", 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6818", 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6819", 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6822", 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6823", 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6820", 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6821", 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 598689172 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6817/598689172", 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6819/598689172", 2024-09-17T16:42:42.853 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6823/598689172", 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6821/598689172", 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 11, 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "21b3d129-c96b-4240-aaaf-682d06b10e50", 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.854 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6802", 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6803", 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6804", 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6805", 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6808", 2024-09-17T16:42:42.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6809", 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6806", 2024-09-17T16:42:42.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6807", 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2000091361 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6803/2000091361", 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6805/2000091361", 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6809/2000091361", 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6807/2000091361", 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.859 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 12, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "953f99d2-c3d1-4bac-b9c7-7f56bed3a05f", 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.860 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 24, 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 0, 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2024-09-17T16:42:42.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 1039497225 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6809/1039497225", 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6811/1039497225", 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6815/1039497225", 2024-09-17T16:42:42.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6813/1039497225", 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 13, 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "a4d32ef9-7344-4d6e-a16c-8cc8623b23a6", 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.866 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 22, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6816", 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6817", 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6818", 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6819", 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6822", 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6823", 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6820", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.98:6821", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2084737149 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.98:6817/2084737149", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.98:6819/2084737149", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.98:6823/2084737149", 2024-09-17T16:42:42.871 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.98:6821/2084737149", 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 14, 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "9305c16f-a01d-4eb1-95ff-df3616720e1f", 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.872 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6824", 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6825", 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6826", 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6827", 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6830", 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6831", 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6828", 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.111:6829", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 3233790125 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.111:6825/3233790125", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.111:6827/3233790125", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.111:6831/3233790125", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.111:6829/3233790125", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.877 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 15, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "9a0ea790-a644-426d-baa7-35a2699a2123", 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 25, 2024-09-17T16:42:42.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 34, 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6810", 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6811", 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6812", 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6813", 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6816", 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6817", 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6814", 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.183:6815", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 2101706733 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.183:6811/2101706733", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.183:6813/2101706733", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.183:6817/2101706733", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.183:6815/2101706733", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2024-09-17T16:42:42.883 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.116010+0000", 2024-09-17T16:42:42.884 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.262806+0000", 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2024-09-17T16:42:42.885 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.286245+0000", 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.886 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.503712+0000", 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.012231+0000", 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.640379+0000", 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.888 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.883245+0000", 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.889 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.851004+0000", 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 8, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.608180+0000", 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 9, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:40.570621+0000", 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 10, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.891 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.142430+0000", 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 11, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.173864+0000", 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 12, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.076485+0000", 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.893 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 13, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:42:42.062460+0000", 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 14, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.842812+0000", 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 15, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540719139924082687, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2024-09-17T16:42:42.895 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2024-09-17T16:41:41.328280+0000", 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_primaries": [], 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "blocklist": {}, 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "range_blocklist": {}, 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2024-09-17T16:42:42.896 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "shecprofile": { 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "c": "2", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-device-class": "", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-num-failure-domains": "0", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-osds-per-failure-domain": "0", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-root": "default", 2024-09-17T16:42:42.897 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "4", 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "3", 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "shecprofile", 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "shec", 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "multiple" 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [ 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "snaps": [ 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 11, 2024-09-17T16:42:42.898 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 1 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 14, 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 1 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "begin": 17, 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "length": 1 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2024-09-17T16:42:42.899 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {}, 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode": { 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_enabled": false, 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_bucket_count": 0, 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "degraded_stretch_mode": 0, 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "recovering_stretch_mode": 0, 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: "stretch_mode_bucket": 0 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:42.900 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:42.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:42.903 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:42.903 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:42.904 INFO:tasks.thrashosds.thrasher:j is {'epoch': 69, 'fsid': 'a18a1a02-ea8d-4573-a275-cb30a154e84c', 'created': '2024-09-17T16:41:30.645147+0000', 'modified': '2024-09-17T16:42:42.437337+0000', 'last_up_change': '2024-09-17T16:41:45.664856+0000', 'last_in_change': '2024-09-17T16:41:34.797369+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 7, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 16, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T16:41:43.059025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 15.380000114440918, 'score_stable': 15.380000114440918, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T16:41:53.164635+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 30, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.990000009536743, 'score_stable': 3.990000009536743, 'optimal_score': 0.6899999976158142, 'raw_score_acting': 2.75, 'raw_score_stable': 2.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'unique_pool_0', 'create_time': '2024-09-17T16:42:06.437635+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 3, 'size': 7, 'min_size': 5, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 69, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'shecprofile', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 16384, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': 'c580007f-04f5-4607-bcb0-9eca9fb6a273', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6816', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6817', 'nonce': 360852295}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6818', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6819', 'nonce': 360852295}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6822', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6823', 'nonce': 360852295}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6820', 'nonce': 360852295}, {'type': 'v1', 'addr': '172.21.15.60:6821', 'nonce': 360852295}]}, 'public_addr': '172.21.15.60:6817/360852295', 'cluster_addr': '172.21.15.60:6819/360852295', 'heartbeat_back_addr': '172.21.15.60:6823/360852295', 'heartbeat_front_addr': '172.21.15.60:6821/360852295', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '5068e4a5-399f-472d-bf4d-0105adfba800', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6824', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6825', 'nonce': 2001248690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6826', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6827', 'nonce': 2001248690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6830', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6831', 'nonce': 2001248690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6828', 'nonce': 2001248690}, {'type': 'v1', 'addr': '172.21.15.98:6829', 'nonce': 2001248690}]}, 'public_addr': '172.21.15.98:6825/2001248690', 'cluster_addr': '172.21.15.98:6827/2001248690', 'heartbeat_back_addr': '172.21.15.98:6831/2001248690', 'heartbeat_front_addr': '172.21.15.98:6829/2001248690', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6808', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6809', 'nonce': 1107977430}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6810', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6811', 'nonce': 1107977430}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6814', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6815', 'nonce': 1107977430}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6812', 'nonce': 1107977430}, {'type': 'v1', 'addr': '172.21.15.111:6813', 'nonce': 1107977430}]}, 'public_addr': '172.21.15.111:6809/1107977430', 'cluster_addr': '172.21.15.111:6811/1107977430', 'heartbeat_back_addr': '172.21.15.111:6815/1107977430', 'heartbeat_front_addr': '172.21.15.111:6813/1107977430', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'e00f6dc3-b74d-441a-abff-55ed4fba87a1', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6826', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6827', 'nonce': 3360497893}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6828', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6829', 'nonce': 3360497893}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6832', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6833', 'nonce': 3360497893}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6830', 'nonce': 3360497893}, {'type': 'v1', 'addr': '172.21.15.183:6831', 'nonce': 3360497893}]}, 'public_addr': '172.21.15.183:6827/3360497893', 'cluster_addr': '172.21.15.183:6829/3360497893', 'heartbeat_back_addr': '172.21.15.183:6833/3360497893', 'heartbeat_front_addr': '172.21.15.183:6831/3360497893', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7d0041d5-389e-4b11-b8e1-535c6113a4f7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6824', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6825', 'nonce': 3686363495}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6826', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6827', 'nonce': 3686363495}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6830', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6831', 'nonce': 3686363495}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6828', 'nonce': 3686363495}, {'type': 'v1', 'addr': '172.21.15.60:6829', 'nonce': 3686363495}]}, 'public_addr': '172.21.15.60:6825/3686363495', 'cluster_addr': '172.21.15.60:6827/3686363495', 'heartbeat_back_addr': '172.21.15.60:6831/3686363495', 'heartbeat_front_addr': '172.21.15.60:6829/3686363495', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '9fc5ba03-7465-43f6-a148-fcecb32304a7', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 23, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6800', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6801', 'nonce': 3943188618}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6802', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6803', 'nonce': 3943188618}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6806', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6807', 'nonce': 3943188618}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6804', 'nonce': 3943188618}, {'type': 'v1', 'addr': '172.21.15.98:6805', 'nonce': 3943188618}]}, 'public_addr': '172.21.15.98:6801/3943188618', 'cluster_addr': '172.21.15.98:6803/3943188618', 'heartbeat_back_addr': '172.21.15.98:6807/3943188618', 'heartbeat_front_addr': '172.21.15.98:6805/3943188618', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '2f2be94b-f485-485b-9d16-80f293b0274c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6800', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6801', 'nonce': 2604225407}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6802', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6803', 'nonce': 2604225407}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6806', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6807', 'nonce': 2604225407}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6804', 'nonce': 2604225407}, {'type': 'v1', 'addr': '172.21.15.111:6805', 'nonce': 2604225407}]}, 'public_addr': '172.21.15.111:6801/2604225407', 'cluster_addr': '172.21.15.111:6803/2604225407', 'heartbeat_back_addr': '172.21.15.111:6807/2604225407', 'heartbeat_front_addr': '172.21.15.111:6805/2604225407', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'eedf3336-c9e3-4c8c-b81a-2f0ebfad326c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6818', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6819', 'nonce': 462795917}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6820', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6821', 'nonce': 462795917}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6824', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6825', 'nonce': 462795917}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6822', 'nonce': 462795917}, {'type': 'v1', 'addr': '172.21.15.183:6823', 'nonce': 462795917}]}, 'public_addr': '172.21.15.183:6819/462795917', 'cluster_addr': '172.21.15.183:6821/462795917', 'heartbeat_back_addr': '172.21.15.183:6825/462795917', 'heartbeat_front_addr': '172.21.15.183:6823/462795917', 'state': ['exists', 'up']}, {'osd': 8, 'uuid': '44e1f674-128a-4388-a488-ffdec5ab479a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6800', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6801', 'nonce': 680830956}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6802', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6803', 'nonce': 680830956}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6806', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6807', 'nonce': 680830956}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6804', 'nonce': 680830956}, {'type': 'v1', 'addr': '172.21.15.60:6805', 'nonce': 680830956}]}, 'public_addr': '172.21.15.60:6801/680830956', 'cluster_addr': '172.21.15.60:6803/680830956', 'heartbeat_back_addr': '172.21.15.60:6807/680830956', 'heartbeat_front_addr': '172.21.15.60:6805/680830956', 'state': ['exists', 'up']}, {'osd': 9, 'uuid': 'c085e6d8-5929-4ab1-826e-cecb51ed73cd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 21, 'up_thru': 27, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6808', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6809', 'nonce': 2482839491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6810', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6811', 'nonce': 2482839491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6814', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6815', 'nonce': 2482839491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6812', 'nonce': 2482839491}, {'type': 'v1', 'addr': '172.21.15.98:6813', 'nonce': 2482839491}]}, 'public_addr': '172.21.15.98:6809/2482839491', 'cluster_addr': '172.21.15.98:6811/2482839491', 'heartbeat_back_addr': '172.21.15.98:6815/2482839491', 'heartbeat_front_addr': '172.21.15.98:6813/2482839491', 'state': ['exists', 'up']}, {'osd': 10, 'uuid': '87248b6a-e219-48a5-911c-4995588e51a2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6816', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6817', 'nonce': 598689172}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6818', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 598689172}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6822', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6823', 'nonce': 598689172}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6820', 'nonce': 598689172}, {'type': 'v1', 'addr': '172.21.15.111:6821', 'nonce': 598689172}]}, 'public_addr': '172.21.15.111:6817/598689172', 'cluster_addr': '172.21.15.111:6819/598689172', 'heartbeat_back_addr': '172.21.15.111:6823/598689172', 'heartbeat_front_addr': '172.21.15.111:6821/598689172', 'state': ['exists', 'up']}, {'osd': 11, 'uuid': '21b3d129-c96b-4240-aaaf-682d06b10e50', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6802', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6803', 'nonce': 2000091361}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6804', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6805', 'nonce': 2000091361}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6808', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6809', 'nonce': 2000091361}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6806', 'nonce': 2000091361}, {'type': 'v1', 'addr': '172.21.15.183:6807', 'nonce': 2000091361}]}, 'public_addr': '172.21.15.183:6803/2000091361', 'cluster_addr': '172.21.15.183:6805/2000091361', 'heartbeat_back_addr': '172.21.15.183:6809/2000091361', 'heartbeat_front_addr': '172.21.15.183:6807/2000091361', 'state': ['exists', 'up']}, {'osd': 12, 'uuid': '953f99d2-c3d1-4bac-b9c7-7f56bed3a05f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 24, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6808', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6809', 'nonce': 1039497225}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6810', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6811', 'nonce': 1039497225}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6814', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6815', 'nonce': 1039497225}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6812', 'nonce': 1039497225}, {'type': 'v1', 'addr': '172.21.15.60:6813', 'nonce': 1039497225}]}, 'public_addr': '172.21.15.60:6809/1039497225', 'cluster_addr': '172.21.15.60:6811/1039497225', 'heartbeat_back_addr': '172.21.15.60:6815/1039497225', 'heartbeat_front_addr': '172.21.15.60:6813/1039497225', 'state': ['exists', 'up']}, {'osd': 13, 'uuid': 'a4d32ef9-7344-4d6e-a16c-8cc8623b23a6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 22, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6816', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6817', 'nonce': 2084737149}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6818', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6819', 'nonce': 2084737149}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6822', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6823', 'nonce': 2084737149}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6820', 'nonce': 2084737149}, {'type': 'v1', 'addr': '172.21.15.98:6821', 'nonce': 2084737149}]}, 'public_addr': '172.21.15.98:6817/2084737149', 'cluster_addr': '172.21.15.98:6819/2084737149', 'heartbeat_back_addr': '172.21.15.98:6823/2084737149', 'heartbeat_front_addr': '172.21.15.98:6821/2084737149', 'state': ['exists', 'up']}, {'osd': 14, 'uuid': '9305c16f-a01d-4eb1-95ff-df3616720e1f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6824', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6825', 'nonce': 3233790125}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6826', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6827', 'nonce': 3233790125}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6830', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6831', 'nonce': 3233790125}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6828', 'nonce': 3233790125}, {'type': 'v1', 'addr': '172.21.15.111:6829', 'nonce': 3233790125}]}, 'public_addr': '172.21.15.111:6825/3233790125', 'cluster_addr': '172.21.15.111:6827/3233790125', 'heartbeat_back_addr': '172.21.15.111:6831/3233790125', 'heartbeat_front_addr': '172.21.15.111:6829/3233790125', 'state': ['exists', 'up']}, {'osd': 15, 'uuid': '9a0ea790-a644-426d-baa7-35a2699a2123', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 25, 'up_thru': 34, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6810', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6811', 'nonce': 2101706733}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6812', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6813', 'nonce': 2101706733}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6816', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6817', 'nonce': 2101706733}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6814', 'nonce': 2101706733}, {'type': 'v1', 'addr': '172.21.15.183:6815', 'nonce': 2101706733}]}, 'public_addr': '172.21.15.183:6811/2101706733', 'cluster_addr': '172.21.15.183:6813/2101706733', 'heartbeat_back_addr': '172.21.15.183:6817/2101706733', 'heartbeat_front_addr': '172.21.15.183:6815/2101706733', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.116010+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.262806+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.286245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.503712+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.012231+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.640379+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.883245+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.851004+0000', 'dead_epoch': 0}, {'osd': 8, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.608180+0000', 'dead_epoch': 0}, {'osd': 9, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:40.570621+0000', 'dead_epoch': 0}, {'osd': 10, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.142430+0000', 'dead_epoch': 0}, {'osd': 11, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.173864+0000', 'dead_epoch': 0}, {'osd': 12, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.076485+0000', 'dead_epoch': 0}, {'osd': 13, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:42:42.062460+0000', 'dead_epoch': 0}, {'osd': 14, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.842812+0000', 'dead_epoch': 0}, {'osd': 15, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540719139924082687, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T16:41:41.328280+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}, 'shecprofile': {'c': '2', 'crush-device-class': '', 'crush-failure-domain': 'osd', 'crush-num-failure-domains': '0', 'crush-osds-per-failure-domain': '0', 'crush-root': 'default', 'k': '4', 'm': '3', 'name': 'shecprofile', 'plugin': 'shec', 'technique': 'multiple'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 1}, {'begin': 14, 'length': 1}, {'begin': 17, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T16:42:42.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:42:42.904 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:42.900+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:42.905 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:43.002 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:43.000+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:43.008 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:43.008 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:43.016 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:43.070 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:43.071 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:43.088 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:43.089 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:43.103 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:43.101+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:43.106 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:43.106 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:43.120 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:43.120 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:43.122 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:43.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:43.138 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:43.139 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:43.155 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:43.156 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:43.172 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:43.189 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:43.203 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:43.201+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:43.206 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:43.207 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:43.223 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:43.224 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:43.232 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:43.232 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:43.241 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:43.242 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:43.242 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:43.247 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:42:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:42:43.258 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:43.258 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:43.260 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-17T16:42:43.052841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":42992179,"num_objects":56,"num_object_clones":9,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":3,"num_read":354,"num_read_kb":50900,"num_write":550,"num_write_kb":62168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":761,"ondisk_log_size":761,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":542100,"kb_used_data":84624,"kb_used_omap":24,"kb_used_meta":457063,"kb_avail":1509407340,"statfs":{"total":1546188226560,"available":1545633116160,"internally_reserved":0,"allocated":86654976,"data_stored":92351221,"data_compressed":1384496,"data_compressed_allocated":2871296,"data_compressed_original":6647808,"omap_allocated":25521,"internal_metadata":468032591},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-425984,"num_objects":-2,"num_object_clones":-1,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":16,"num_read_kb":4774,"num_write":53,"num_write_kb":1904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000719"},"pg_stats":[{"pgid":"3.f","version":"63'12","reported_seq":170,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.445727+0000","last_change":"2024-09-17T16:42:36.450180+0000","last_active":"2024-09-17T16:42:38.445727+0000","last_peered":"2024-09-17T16:42:38.445727+0000","last_clean":"2024-09-17T16:42:38.445727+0000","last_became_active":"2024-09-17T16:42:08.901951+0000","last_became_peered":"2024-09-17T16:42:08.901951+0000","last_unstale":"2024-09-17T16:42:38.445727+0000","last_undegraded":"2024-09-17T16:42:38.445727+0000","last_fullsized":"2024-09-17T16:42:38.445727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:10.802213+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0081061329999999997,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1542,"num_write":22,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,14,11,7,10,0],"acting":[13,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"8","length":"2"},{"start":"b","length":"4"}]},{"pgid":"3.e","version":"69'71","reported_seq":242,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.447401+0000","last_change":"2024-09-17T16:42:41.452797+0000","last_active":"2024-09-17T16:42:42.447401+0000","last_peered":"2024-09-17T16:42:42.447401+0000","last_clean":"2024-09-17T16:42:42.447401+0000","last_became_active":"2024-09-17T16:42:09.288377+0000","last_became_peered":"2024-09-17T16:42:09.288377+0000","last_unstale":"2024-09-17T16:42:42.447401+0000","last_undegraded":"2024-09-17T16:42:42.447401+0000","last_fullsized":"2024-09-17T16:42:42.447401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:25.054528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081503140000000005,"stat_sum":{"num_bytes":1032192,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":2946,"num_write":42,"num_write_kb":5152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,13,8,6,12],"acting":[2,11,5,13,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.d","version":"37'4","reported_seq":162,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.445608+0000","last_change":"2024-09-17T16:42:36.442739+0000","last_active":"2024-09-17T16:42:38.445608+0000","last_peered":"2024-09-17T16:42:38.445608+0000","last_clean":"2024-09-17T16:42:38.445608+0000","last_became_active":"2024-09-17T16:42:09.119028+0000","last_became_peered":"2024-09-17T16:42:09.119028+0000","last_unstale":"2024-09-17T16:42:38.445608+0000","last_undegraded":"2024-09-17T16:42:38.445608+0000","last_fullsized":"2024-09-17T16:42:38.445608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:19.180707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076396000000000005,"stat_sum":{"num_bytes":671744,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":4,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,14,10,9,8,4],"acting":[13,1,14,10,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"8","length":"2"},{"start":"b","length":"4"}]},{"pgid":"3.c","version":"65'128","reported_seq":296,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.449942+0000","last_change":"2024-09-17T16:42:36.458316+0000","last_active":"2024-09-17T16:42:38.449942+0000","last_peered":"2024-09-17T16:42:38.449942+0000","last_clean":"2024-09-17T16:42:38.449942+0000","last_became_active":"2024-09-17T16:42:09.287827+0000","last_became_peered":"2024-09-17T16:42:09.287827+0000","last_unstale":"2024-09-17T16:42:38.449942+0000","last_undegraded":"2024-09-17T16:42:38.449942+0000","last_fullsized":"2024-09-17T16:42:38.449942+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:19.102833+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.014674725,"stat_sum":{"num_bytes":7962624,"num_objects":9,"num_object_clones":2,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":58,"num_read_kb":10476,"num_write":106,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,10,6,12,3],"acting":[5,8,13,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"2"},{"start":"b","length":"4"}]},{"pgid":"3.b","version":"64'84","reported_seq":258,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.446606+0000","last_change":"2024-09-17T16:42:41.441164+0000","last_active":"2024-09-17T16:42:42.446606+0000","last_peered":"2024-09-17T16:42:42.446606+0000","last_clean":"2024-09-17T16:42:42.446606+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:42:42.446606+0000","last_undegraded":"2024-09-17T16:42:42.446606+0000","last_fullsized":"2024-09-17T16:42:42.446606+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.664830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091174400000000003,"stat_sum":{"num_bytes":3145728,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":3255,"num_write":28,"num_write_kb":6656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.a","version":"65'31","reported_seq":199,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.478026+0000","last_change":"2024-09-17T16:42:36.443172+0000","last_active":"2024-09-17T16:42:38.478026+0000","last_peered":"2024-09-17T16:42:38.478026+0000","last_clean":"2024-09-17T16:42:38.478026+0000","last_became_active":"2024-09-17T16:42:09.120200+0000","last_became_peered":"2024-09-17T16:42:09.120200+0000","last_unstale":"2024-09-17T16:42:38.478026+0000","last_undegraded":"2024-09-17T16:42:38.478026+0000","last_fullsized":"2024-09-17T16:42:38.478026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:34.370665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010699170000000001,"stat_sum":{"num_bytes":3735552,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":21,"num_read_kb":9726,"num_write":18,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,14,6,10],"acting":[13,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"8","length":"2"},{"start":"b","length":"4"}]},{"pgid":"3.9","version":"64'48","reported_seq":218,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.440473+0000","last_change":"2024-09-17T16:42:41.440797+0000","last_active":"2024-09-17T16:42:41.440473+0000","last_peered":"2024-09-17T16:42:41.440473+0000","last_clean":"2024-09-17T16:42:41.440473+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:42:41.440473+0000","last_undegraded":"2024-09-17T16:42:41.440473+0000","last_fullsized":"2024-09-17T16:42:41.440473+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:32.753112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056811899999999996,"stat_sum":{"num_bytes":1720320,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":5251,"num_write":16,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.8","version":"63'28","reported_seq":202,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.444977+0000","last_change":"2024-09-17T16:42:41.445272+0000","last_active":"2024-09-17T16:42:41.444977+0000","last_peered":"2024-09-17T16:42:41.444977+0000","last_clean":"2024-09-17T16:42:41.444977+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:42:41.444977+0000","last_undegraded":"2024-09-17T16:42:41.444977+0000","last_fullsized":"2024-09-17T16:42:41.444977+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:23.523383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045136599999999997,"stat_sum":{"num_bytes":147456,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":2758,"num_write":30,"num_write_kb":2464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"1.0","version":"24'92","reported_seq":99,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.444728+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:42:41.444728+0000","last_peered":"2024-09-17T16:42:41.444728+0000","last_clean":"2024-09-17T16:42:41.444728+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:42:41.444728+0000","last_undegraded":"2024-09-17T16:42:41.444728+0000","last_fullsized":"2024-09-17T16:42:41.444728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:05.382727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":95,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.444569+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:42:41.444569+0000","last_peered":"2024-09-17T16:42:41.444569+0000","last_clean":"2024-09-17T16:42:41.444569+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:42:41.444569+0000","last_undegraded":"2024-09-17T16:42:41.444569+0000","last_fullsized":"2024-09-17T16:42:41.444569+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":168,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.444836+0000","last_change":"2024-09-17T16:42:41.445115+0000","last_active":"2024-09-17T16:42:41.444836+0000","last_peered":"2024-09-17T16:42:41.444836+0000","last_clean":"2024-09-17T16:42:41.444836+0000","last_became_active":"2024-09-17T16:42:09.120070+0000","last_became_peered":"2024-09-17T16:42:09.120070+0000","last_unstale":"2024-09-17T16:42:41.444836+0000","last_undegraded":"2024-09-17T16:42:41.444836+0000","last_fullsized":"2024-09-17T16:42:41.444836+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:34.146947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059919900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,13,1,5,3,7],"acting":[11,2,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.451556+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:42:42.451556+0000","last_peered":"2024-09-17T16:42:42.451556+0000","last_clean":"2024-09-17T16:42:42.451556+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:42:42.451556+0000","last_undegraded":"2024-09-17T16:42:42.451556+0000","last_fullsized":"2024-09-17T16:42:42.451556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:07.350839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"68'34","reported_seq":215,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.446535+0000","last_change":"2024-09-17T16:42:41.441418+0000","last_active":"2024-09-17T16:42:42.446535+0000","last_peered":"2024-09-17T16:42:42.446535+0000","last_clean":"2024-09-17T16:42:42.446535+0000","last_became_active":"2024-09-17T16:42:08.902123+0000","last_became_peered":"2024-09-17T16:42:08.902123+0000","last_unstale":"2024-09-17T16:42:42.446535+0000","last_undegraded":"2024-09-17T16:42:42.446535+0000","last_fullsized":"2024-09-17T16:42:42.446535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:16.945398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001286033,"stat_sum":{"num_bytes":3883008,"num_objects":6,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":23,"num_read_kb":2108,"num_write":38,"num_write_kb":3792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,3,11,10,2,7],"acting":[4,13,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.640337+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:42:40.640337+0000","last_peered":"2024-09-17T16:42:40.640337+0000","last_clean":"2024-09-17T16:42:40.640337+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:42:40.640337+0000","last_undegraded":"2024-09-17T16:42:40.640337+0000","last_fullsized":"2024-09-17T16:42:40.640337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.836209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"42'11","reported_seq":179,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T16:42:41.440225+0000","last_change":"2024-09-17T16:42:41.440537+0000","last_active":"2024-09-17T16:42:41.440225+0000","last_peered":"2024-09-17T16:42:41.440225+0000","last_clean":"2024-09-17T16:42:41.440225+0000","last_became_active":"2024-09-17T16:42:08.817399+0000","last_became_peered":"2024-09-17T16:42:08.817399+0000","last_unstale":"2024-09-17T16:42:41.440225+0000","last_undegraded":"2024-09-17T16:42:41.440225+0000","last_fullsized":"2024-09-17T16:42:41.440225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:30.882451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053479299999999999,"stat_sum":{"num_bytes":901120,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":2315,"num_write":7,"num_write_kb":880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,13,11,4],"acting":[14,2,9,3,13,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.2","version":"30'2","reported_seq":90,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.445563+0000","last_change":"2024-09-17T16:41:57.130174+0000","last_active":"2024-09-17T16:42:38.445563+0000","last_peered":"2024-09-17T16:42:38.445563+0000","last_clean":"2024-09-17T16:42:38.445563+0000","last_became_active":"2024-09-17T16:41:55.133445+0000","last_became_peered":"2024-09-17T16:41:55.133445+0000","last_unstale":"2024-09-17T16:42:38.445563+0000","last_undegraded":"2024-09-17T16:42:38.445563+0000","last_fullsized":"2024-09-17T16:42:38.445563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:13.825618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010439119999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.3","version":"63'38","reported_seq":215,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.640588+0000","last_change":"2024-09-17T16:42:36.452925+0000","last_active":"2024-09-17T16:42:40.640588+0000","last_peered":"2024-09-17T16:42:40.640588+0000","last_clean":"2024-09-17T16:42:40.640588+0000","last_became_active":"2024-09-17T16:42:08.901463+0000","last_became_peered":"2024-09-17T16:42:08.901463+0000","last_unstale":"2024-09-17T16:42:40.640588+0000","last_undegraded":"2024-09-17T16:42:40.640588+0000","last_fullsized":"2024-09-17T16:42:40.640588+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:34.838105+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0080955760000000002,"stat_sum":{"num_bytes":4046848,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":3202,"num_write":18,"num_write_kb":4464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,13,2,10,5],"acting":[15,9,4,13,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"}]},{"pgid":"3.5","version":"63'33","reported_seq":190,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.442111+0000","last_change":"2024-09-17T16:42:36.451320+0000","last_active":"2024-09-17T16:42:38.442111+0000","last_peered":"2024-09-17T16:42:38.442111+0000","last_clean":"2024-09-17T16:42:38.442111+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:42:38.442111+0000","last_undegraded":"2024-09-17T16:42:38.442111+0000","last_fullsized":"2024-09-17T16:42:38.442111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:20.608521+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0076724219999999999,"stat_sum":{"num_bytes":2457600,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":14,"num_write_kb":2752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"2"},{"start":"b","length":"4"}]},{"pgid":"2.4","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.446600+0000","last_change":"2024-09-17T16:41:57.186059+0000","last_active":"2024-09-17T16:42:42.446600+0000","last_peered":"2024-09-17T16:42:42.446600+0000","last_clean":"2024-09-17T16:42:42.446600+0000","last_became_active":"2024-09-17T16:41:55.116725+0000","last_became_peered":"2024-09-17T16:41:55.116725+0000","last_unstale":"2024-09-17T16:42:42.446600+0000","last_undegraded":"2024-09-17T16:42:42.446600+0000","last_fullsized":"2024-09-17T16:42:42.446600+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.947359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037525200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"62'40","reported_seq":213,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.452749+0000","last_change":"2024-09-17T16:42:41.448774+0000","last_active":"2024-09-17T16:42:42.452749+0000","last_peered":"2024-09-17T16:42:42.452749+0000","last_clean":"2024-09-17T16:42:42.452749+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:42:42.452749+0000","last_undegraded":"2024-09-17T16:42:42.452749+0000","last_fullsized":"2024-09-17T16:42:42.452749+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:26.337565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061882500000000004,"stat_sum":{"num_bytes":2965504,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":2956,"num_write":16,"num_write_kb":3008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T16:42:40.446111+0000","last_change":"2024-09-17T16:41:57.122509+0000","last_active":"2024-09-17T16:42:40.446111+0000","last_peered":"2024-09-17T16:42:40.446111+0000","last_clean":"2024-09-17T16:42:40.446111+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:42:40.446111+0000","last_undegraded":"2024-09-17T16:42:40.446111+0000","last_fullsized":"2024-09-17T16:42:40.446111+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:42:54.531823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"65'49","reported_seq":222,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.452070+0000","last_change":"2024-09-17T16:42:41.441504+0000","last_active":"2024-09-17T16:42:42.452070+0000","last_peered":"2024-09-17T16:42:42.452070+0000","last_clean":"2024-09-17T16:42:42.452070+0000","last_became_active":"2024-09-17T16:42:08.914114+0000","last_became_peered":"2024-09-17T16:42:08.914114+0000","last_unstale":"2024-09-17T16:42:42.452070+0000","last_undegraded":"2024-09-17T16:42:42.452070+0000","last_fullsized":"2024-09-17T16:42:42.452070+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:20.983788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093037199999999995,"stat_sum":{"num_bytes":3309568,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":4287,"num_write":41,"num_write_kb":4416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,13],"acting":[4,6,7,0,11,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.452667+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:42:42.452667+0000","last_peered":"2024-09-17T16:42:42.452667+0000","last_clean":"2024-09-17T16:42:42.452667+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:42:42.452667+0000","last_undegraded":"2024-09-17T16:42:42.452667+0000","last_fullsized":"2024-09-17T16:42:42.452667+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:03.758569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"63'55","reported_seq":226,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T16:42:42.441275+0000","last_change":"2024-09-17T16:42:41.604419+0000","last_active":"2024-09-17T16:42:42.441275+0000","last_peered":"2024-09-17T16:42:42.441275+0000","last_clean":"2024-09-17T16:42:42.441275+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:42:42.441275+0000","last_undegraded":"2024-09-17T16:42:42.441275+0000","last_fullsized":"2024-09-17T16:42:42.441275+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:08.581480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052232600000000004,"stat_sum":{"num_bytes":5783552,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":25,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"b","length":"1"},{"start":"e","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":88,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-17T16:42:38.445838+0000","last_change":"2024-09-17T16:41:57.129605+0000","last_active":"2024-09-17T16:42:38.445838+0000","last_peered":"2024-09-17T16:42:38.445838+0000","last_clean":"2024-09-17T16:42:38.445838+0000","last_became_active":"2024-09-17T16:41:55.117031+0000","last_became_peered":"2024-09-17T16:41:55.117031+0000","last_unstale":"2024-09-17T16:42:38.445838+0000","last_undegraded":"2024-09-17T16:42:38.445838+0000","last_fullsized":"2024-09-17T16:42:38.445838+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:12.473544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047792599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":42401792,"num_objects":52,"num_object_clones":9,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":3,"num_read":278,"num_read_kb":50836,"num_write":425,"num_write_kb":60016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74596352,"data_stored":85311488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":666,"ondisk_log_size":666,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182416,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":4312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":4415488,"data_stored":4178158,"data_compressed":86053,"data_compressed_allocated":176128,"data_compressed_original":352256,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182416,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34560,"kb_used_data":3364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337280,"statfs":{"total":96636764160,"available":96601374720,"internally_reserved":0,"allocated":3444736,"data_stored":3207406,"data_compressed":86053,"data_compressed_allocated":176128,"data_compressed_original":352256,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182416,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37704,"kb_used_data":6516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334136,"statfs":{"total":96636764160,"available":96598155264,"internally_reserved":0,"allocated":6672384,"data_stored":7717646,"data_compressed":93324,"data_compressed_allocated":208896,"data_compressed_original":876544,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280526,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":4944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":5062656,"data_stored":5478727,"data_compressed":88076,"data_compressed_allocated":180224,"data_compressed_original":360448,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280525,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34120,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337720,"statfs":{"total":96636764160,"available":96601825280,"internally_reserved":0,"allocated":7262208,"data_stored":7026806,"data_compressed":79990,"data_compressed_allocated":163840,"data_compressed_original":327680,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280526,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31152,"kb_used_data":4120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340688,"statfs":{"total":96636764160,"available":96604864512,"internally_reserved":0,"allocated":4218880,"data_stored":5000039,"data_compressed":94528,"data_compressed_allocated":212992,"data_compressed_original":872448,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280526,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32996,"kb_used_data":5964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338844,"statfs":{"total":96636764160,"available":96602976256,"internally_reserved":0,"allocated":6107136,"data_stored":6928711,"data_compressed":88076,"data_compressed_allocated":180224,"data_compressed_original":360448,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313231,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":5244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":5369856,"data_stored":5919130,"data_compressed":90094,"data_compressed_allocated":184320,"data_compressed_original":368640,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313231,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31160,"kb_used_data":4128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340680,"statfs":{"total":96636764160,"available":96604856320,"internally_reserved":0,"allocated":4227072,"data_stored":3987783,"data_compressed":88076,"data_compressed_allocated":180224,"data_compressed_original":360448,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247823,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38432,"kb_used_data":7236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333408,"statfs":{"total":96636764160,"available":96597409792,"internally_reserved":0,"allocated":7409664,"data_stored":7598196,"data_compressed":82008,"data_compressed_allocated":167936,"data_compressed_original":335872,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215117,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29620,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342220,"statfs":{"total":96636764160,"available":96606433280,"internally_reserved":0,"allocated":2650112,"data_stored":2621556,"data_compressed":82008,"data_compressed_allocated":167936,"data_compressed_original":335872,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215120,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":6040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":6184960,"data_stored":7026821,"data_compressed":84027,"data_compressed_allocated":172032,"data_compressed_original":344064,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215119,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39668,"kb_used_data":8472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332172,"statfs":{"total":96636764160,"available":96596144128,"internally_reserved":0,"allocated":8675328,"data_stored":9312389,"data_compressed":84027,"data_compressed_allocated":172032,"data_compressed_original":344064,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215119,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35476,"kb_used_data":4288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336364,"statfs":{"total":96636764160,"available":96600436736,"internally_reserved":0,"allocated":4390912,"data_stored":4778136,"data_compressed":84027,"data_compressed_allocated":172032,"data_compressed_original":344064,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182416,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":4580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":4689920,"data_stored":5278023,"data_compressed":88076,"data_compressed_allocated":180224,"data_compressed_original":360448,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182414,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":5736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":5873664,"data_stored":6291694,"data_compressed":86053,"data_compressed_allocated":176128,"data_compressed_original":352256,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4956160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1925120,"data_stored":2129920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3403776,"data_stored":3997696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3928064,"data_stored":4755456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5345280,"data_stored":6492160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6684672,"data_stored":7106560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5447680,"data_stored":6664192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5124096,"data_stored":6184960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4595712,"data_stored":5386240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3551232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7938048,"data_stored":8810496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":5881856,"data_stored":7081984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":3649536,"data_stored":4415488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":7417856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":2695168,"data_stored":2695168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":3665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:42:43.262 INFO:tasks.thrashosds.thrasher:Setting 2.4 to [11, 4] 2024-09-17T16:42:43.262 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.4', '11', '4'] 2024-09-17T16:42:43.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.4 11 4 2024-09-17T16:42:43.274 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:43.275 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:43.292 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:43.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:43.290+0000 7fb146ffd640 0 -- 172.21.15.60:0/4114345901 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fb1482214b0 msgr2=0x7fb1482238a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:43.304 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:43.302+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:43.345 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4353.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 48.228301324, 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019887846000000001, 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.346 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4353", 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 1 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:43.347 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114602+0000", 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4899999999999999e-06 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114608+0000", 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5269999999999998e-06 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.348 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114617+0000", 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114624+0000", 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114751+0000", 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012672599999999999 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.349 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114762+0000", 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0988000000000001e-05 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133140+0000", 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018378205000000002 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133255+0000", 2024-09-17T16:42:43.350 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011454 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 5", 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133361+0000", 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134291+0000", 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00092989899999999998 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.351 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134428+0000", 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013742100000000001 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134460+0000", 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1696000000000003e-05 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134488+0000", 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8839999999999998e-05 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.352 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:180 3.8s0 3:1f669f2f:::smithi18337221-38:head [copy-from ver 4] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.882357947999999, 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539511, 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.353 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 180 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.354 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460545+0000", 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789999999999999e-06 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460557+0000", 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1426e-05 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.355 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460574+0000", 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7201e-05 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460585+0000", 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1151e-05 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460659+0000", 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3627000000000005e-05 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.356 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460665+0000", 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8799999999999996e-06 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465756+0000", 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050914580000000001 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465824+0000", 2024-09-17T16:42:43.357 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7695999999999997e-05 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.471499+0000", 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056752800000000004 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474733+0000", 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336159999999999 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.358 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475885+0000", 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011522209999999999 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475939+0000", 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4075e-05 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:181 3.8s0 3:1f669f2f:::smithi18337221-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:43.359 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.882295102, 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012676972999999999, 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 181 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.360 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7700000000000005e-07 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.361 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460610+0000", 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.255e-06 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460615+0000", 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4210000000000003e-06 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460619+0000", 2024-09-17T16:42:43.362 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9580000000000001e-06 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460721+0000", 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000101939 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460728+0000", 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8040000000000004e-06 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.363 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466017+0000", 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052897680000000002 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466075+0000", 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7250999999999998e-05 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473120+0000", 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070448159999999998 2024-09-17T16:42:43.364 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473208+0000", 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8794000000000004e-05 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473284+0000", 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5489999999999997e-05 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.365 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:205 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~540672] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.856298059, 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022798883999999998, 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 205 2024-09-17T16:42:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486616+0000", 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2235999999999999e-05 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487273+0000", 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065649800000000004 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487287+0000", 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4691e-05 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.368 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487297+0000", 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6360000000000006e-06 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488723+0000", 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014264239999999999 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488837+0000", 2024-09-17T16:42:43.369 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011340000000000001 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490257+0000", 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014198100000000001 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503813+0000", 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013556586000000001 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.370 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509302+0000", 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054885029999999996 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001011 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:206 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:43.371 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.853117551, 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020001278000000001, 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 206 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.372 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489787+0000", 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.193e-06 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.373 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490081+0000", 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029397100000000002 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490112+0000", 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1084999999999998e-05 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490123+0000", 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1440999999999999e-05 2024-09-17T16:42:43.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498510+0000", 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083867290000000008 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498626+0000", 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011602700000000001 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.375 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499572+0000", 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00094589999999999995 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504786+0000", 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005214148 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509716+0000", 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049301520000000001 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.376 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509786+0000", 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9632e-05 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:207 3.8s0 3:1b608a02:::smithi18337221-50:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.852759370000001, 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020510362000000001, 2024-09-17T16:42:43.377 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 207 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.378 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490149+0000", 2024-09-17T16:42:43.379 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.135e-06 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490157+0000", 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9060000000000002e-06 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490162+0000", 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1229999999999999e-06 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505559+0000", 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539709 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505695+0000", 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135969 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506337+0000", 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064216000000000002 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.381 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507545+0000", 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012081609999999999 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510574+0000", 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030285519999999999 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510653+0000", 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9348e-05 2024-09-17T16:42:43.382 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:208 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.852731308999999, 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021610111000000001, 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.383 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 208 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:43.384 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490174+0000", 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7350000000000001e-06 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.385 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490181+0000", 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9890000000000003e-06 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490186+0000", 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2299999999999999e-06 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506594+0000", 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016408049000000001 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.386 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507224+0000", 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000629881 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510953+0000", 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037285399999999998 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511114+0000", 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016097400000000001 2024-09-17T16:42:43.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511781+0000", 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066716099999999999 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.844243011, 2024-09-17T16:42:43.388 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086096929999999999, 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498660+0000", 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2399999999999996e-07 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498679+0000", 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9306000000000001e-05 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.390 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498692+0000", 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3247999999999999e-05 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498711+0000", 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8244e-05 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503918+0000", 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052073960000000004 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.391 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503938+0000", 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0027999999999999e-05 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507239+0000", 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033006559999999999 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507269+0000", 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9890999999999999e-05 2024-09-17T16:42:43.392 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s1 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 24.834460031999999, 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088156980000000003, 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.393 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:42:43.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509059+0000", 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00061633200000000003 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509089+0000", 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9966000000000001e-05 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509098+0000", 2024-09-17T16:42:43.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509196+0000", 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7888999999999997e-05 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509204+0000", 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1289999999999996e-06 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517216+0000", 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008012 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517258+0000", 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1189000000000002e-05 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:43.397 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 19.881467010000001, 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092754329999999996, 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0399999999999996e-07 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461889+0000", 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045319700000000002 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461900+0000", 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1837e-05 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461909+0000", 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3590000000000008e-06 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461957+0000", 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8575999999999997e-05 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461963+0000", 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7699999999999998e-06 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.470674+0000", 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0087108930000000008 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.470710+0000", 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6297000000000002e-05 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.401 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:367 3.8s0 3:1b608a02:::smithi18337221-50:b [read 0~1753088,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.840285438, 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082445369999999997, 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 367 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502617+0000", 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.23e-07 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502623+0000", 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0959999999999997e-06 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502634+0000", 2024-09-17T16:42:43.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0899e-05 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502642+0000", 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3209999999999999e-06 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505267+0000", 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002625643 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505339+0000", 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1939000000000004e-05 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510861+0000", 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0055218159999999997 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:368 3.8s0 3:1b608a02:::smithi18337221-50:b [read 1295654~457434,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:43.406 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.840243961000001, 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0099805280000000007, 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 368 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502659+0000", 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502663+0000", 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0269999999999997e-06 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502670+0000", 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502676+0000", 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3269999999999997e-06 2024-09-17T16:42:43.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510962+0000", 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082857139999999996 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.511066+0000", 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010427199999999999 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512639+0000", 2024-09-17T16:42:43.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015722690000000001 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.735962379, 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011225425000000001, 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.411 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606941+0000", 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0869999999999999e-06 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607290+0000", 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034908900000000002 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607308+0000", 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8522999999999999e-05 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607322+0000", 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3582e-05 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607407+0000", 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5463000000000005e-05 2024-09-17T16:42:43.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607417+0000", 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6090000000000007e-06 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618132+0000", 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010714672999999999 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618165+0000", 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3399000000000003e-05 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.8241954840000005, 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01393165, 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.416 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518707+0000", 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.47e-07 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519373+0000", 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066530699999999996 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519390+0000", 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7329e-05 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519407+0000", 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7022999999999999e-05 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519617+0000", 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000209564 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519641+0000", 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4725000000000001e-05 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532562+0000", 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012920769 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532638+0000", 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5986000000000001e-05 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.420 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.8164560949999995, 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0093138409999999998, 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526447+0000", 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7599999999999997e-07 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526616+0000", 2024-09-17T16:42:43.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000169803 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526630+0000", 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3246e-05 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526638+0000", 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9859999999999994e-06 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527416+0000", 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00077817999999999995 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527426+0000", 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.012e-05 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.535735+0000", 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083096039999999999 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.535760+0000", 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4226000000000001e-05 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.425 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=151, reqid=client.4553.0:435, at_version=60'21, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.530402+0000", 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.8124994880000003, 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083721860000000002, 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530402+0000", 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530402+0000", 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530403+0000", 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8599999999999996e-07 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530455+0000", 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1844e-05 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530468+0000", 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.259e-05 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530477+0000", 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6789999999999994e-06 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532759+0000", 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022822060000000002 2024-09-17T16:42:43.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532769+0000", 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0317e-05 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.538734+0000", 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059645139999999998 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.538775+0000", 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1050000000000002e-05 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.7531347680000007, 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011351075, 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.430 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589768+0000", 2024-09-17T16:42:43.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5000000000000002e-07 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590376+0000", 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000607812 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590388+0000", 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1968e-05 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.432 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590393+0000", 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5929999999999996e-06 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590459+0000", 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5939999999999995e-05 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590466+0000", 2024-09-17T16:42:43.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8390000000000001e-06 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601035+0000", 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010569017999999999 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601118+0000", 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3154999999999999e-05 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.434 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 61/34 ECSubWrite(tid=149, reqid=osd.2.0:149, at_version=61'51, trim_to=0'0, roll_forward_to=60'49))", 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8294830770000008, 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097004719999999999, 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:43.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.41e-07 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513443+0000", 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4164000000000001e-05 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513452+0000", 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1449999999999997e-06 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513459+0000", 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1739999999999997e-06 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513548+0000", 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9395999999999996e-05 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513559+0000", 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1191e-05 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522009+0000", 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0084501660000000003 2024-09-17T16:42:43.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523119+0000", 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011099949999999999 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 61/34 ECSubWrite(tid=54, reqid=osd.0.0:54, at_version=61'47, trim_to=0'0, roll_forward_to=60'45))", 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.514438+0000", 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.8284635110000007, 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0087893910000000006, 2024-09-17T16:42:43.439 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514438+0000", 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514438+0000", 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514439+0000", 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5300000000000003e-07 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514466+0000", 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7046000000000002e-05 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514482+0000", 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5336e-05 2024-09-17T16:42:43.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514491+0000", 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9260000000000006e-06 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514552+0000", 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1103000000000001e-05 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514561+0000", 2024-09-17T16:42:43.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.166e-06 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523193+0000", 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008631807 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523228+0000", 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5154000000000003e-05 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 61/34 ECSubWrite(tid=150, reqid=osd.2.0:150, at_version=61'53, trim_to=0'0, roll_forward_to=60'49))", 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.514940+0000", 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.827961964, 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083252989999999995, 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514940+0000", 2024-09-17T16:42:43.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514940+0000", 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514941+0000", 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0100000000000001e-06 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514964+0000", 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.321e-05 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514978+0000", 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3769e-05 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514997+0000", 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8790000000000001e-05 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515079+0000", 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1823999999999995e-05 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515088+0000", 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9059999999999997e-06 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523232+0000", 2024-09-17T16:42:43.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081438840000000005 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523265+0000", 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2906e-05 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.448 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:43.450 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:43.450 INFO:tasks.rados.rados.0.smithi183.stdout:215: done (6 left) 2024-09-17T16:42:43.450 INFO:tasks.rados.rados.0.smithi183.stdout:216: setattr oid 27 current snap is 18 2024-09-17T16:42:43.450 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 21 v 6 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-17T16:42:43.450 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 26 v 71 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-09-17T16:42:43.450 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 50 v 29 (ObjNum 289 snap 0 seq_num 1271541735) dirty exists 2024-09-17T16:42:43.451 INFO:tasks.rados.rados.0.smithi183.stdout:208: expect (ObjNum 56 snap 3 seq_num 56) 2024-09-17T16:42:43.451 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:43.451 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:43.447+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:43.458 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:43.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:42:43.468 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:43.478 INFO:tasks.rados.rados.0.smithi183.stdout:213: finishing write tid 1 to smithi18337221-23 2024-09-17T16:42:43.478 INFO:tasks.rados.rados.0.smithi183.stdout:213: finishing write tid 2 to smithi18337221-23 2024-09-17T16:42:43.478 INFO:tasks.rados.rados.0.smithi183.stdout:213: finishing write tid 3 to smithi18337221-23 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: finishing write tid 4 to smithi18337221-23 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: finishing write tid 5 to smithi18337221-23 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: oid 23 updating version 0 to 133 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: oid 23 version 133 is already newer than 132 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: oid 23 version 133 is already newer than 131 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: oid 23 version 133 is already newer than 130 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 23 v 133 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: left oid 23 (ObjNum 93 snap 18 seq_num 93) 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:208: done (6 left) 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:210: done (5 left) 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:211: done (4 left) 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:212: done (3 left) 2024-09-17T16:42:43.479 INFO:tasks.rados.rados.0.smithi183.stdout:213: done (2 left) 2024-09-17T16:42:43.480 INFO:tasks.rados.rados.0.smithi183.stdout:214: done (1 left) 2024-09-17T16:42:43.480 INFO:tasks.rados.rados.0.smithi183.stdout:217: setattr oid 14 current snap is 18 2024-09-17T16:42:43.480 INFO:tasks.rados.rados.0.smithi183.stdout:218: snap_create 2024-09-17T16:42:43.483 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 27 v 33 (ObjNum 77 snap 11 seq_num 77) dirty exists 2024-09-17T16:42:43.484 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 14 v 137 (ObjNum 86 snap 13 seq_num 86) dirty exists 2024-09-17T16:42:43.527 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:43.527 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:43.546 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:43.546 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:43.550 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:43.548+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:43.556 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:43.556 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:43.557 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:43.557 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:43.566 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:43.651 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:43.649+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:43.709 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:43.709 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:43.709 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:43.709 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:43.710 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:43.718 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:43.752 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:43.750+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:43.853 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:43.851+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:43.863 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:43.863 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:43.863 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.369790447, 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080373609999999998, 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.864 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9900000000000001e-07 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.865 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490977+0000", 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000139412 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490997+0000", 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.052e-05 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491011+0000", 2024-09-17T16:42:43.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4304999999999999e-05 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491130+0000", 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011833900000000001 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491143+0000", 2024-09-17T16:42:43.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2986000000000001e-05 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498835+0000", 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076927319999999999 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498874+0000", 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8668000000000003e-05 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.868 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 25.352423418000001, 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0091817740000000002, 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.869 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:43.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.91e-07 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508622+0000", 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041787699999999998 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508636+0000", 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4331999999999999e-05 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508644+0000", 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508713+0000", 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9888000000000006e-05 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508723+0000", 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.713e-06 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517349+0000", 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086254179999999993 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517386+0000", 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6971000000000002e-05 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:270 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~655360] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 24.340191549, 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013861503000000001, 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 270 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520438+0000", 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0849999999999999e-06 2024-09-17T16:42:43.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520784+0000", 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034672700000000002 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520799+0000", 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4945e-05 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520809+0000", 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999997e-06 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520888+0000", 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9523000000000004e-05 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.521021+0000", 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013319300000000001 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522568+0000", 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015468770000000001 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085082820000000007 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534240+0000", 2024-09-17T16:42:43.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031634889999999998 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534297+0000", 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:271 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:43.879 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 24.337796423, 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01199191, 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 271 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.880 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522833+0000", 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.889e-06 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523129+0000", 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029651599999999998 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523150+0000", 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0537e-05 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523159+0000", 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2329999999999995e-06 2024-09-17T16:42:43.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527318+0000", 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041587719999999998 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527398+0000", 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0752000000000002e-05 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527918+0000", 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051932300000000003 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531167+0000", 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032495649999999998 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534786+0000", 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036188050000000001 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534823+0000", 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6517999999999998e-05 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:272 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 24.337448000999998, 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011828584, 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.885 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 272 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523180+0000", 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523184+0000", 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1989999999999999e-06 2024-09-17T16:42:43.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523202+0000", 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7932999999999999e-05 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523210+0000", 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5050000000000001e-06 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530456+0000", 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072466300000000004 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3615999999999995e-05 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530847+0000", 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032758 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531332+0000", 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048465900000000002 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534949+0000", 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036167159999999999 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535008+0000", 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9038e-05 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.890 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:273 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 24.337405148999999, 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012586701, 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.891 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 273 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523223+0000", 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523226+0000", 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2150000000000001e-06 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.893 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9100000000000005e-06 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523241+0000", 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1899999999999998e-06 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531097+0000", 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078564370000000008 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531159+0000", 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535259+0000", 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041002670000000003 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535355+0000", 2024-09-17T16:42:43.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5707999999999999e-05 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535809+0000", 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045409299999999998 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:297 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~737280] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:43.896 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 20.378637125000001, 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011819003, 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 297 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:43.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481992+0000", 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.001e-06 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482367+0000", 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037461699999999999 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482382+0000", 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5693e-05 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482389+0000", 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.08e-06 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482440+0000", 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0917000000000001e-05 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482445+0000", 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6410000000000001e-06 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484030+0000", 2024-09-17T16:42:43.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001585328 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484091+0000", 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0677999999999997e-05 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.485118+0000", 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010273400000000001 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493041+0000", 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079222289999999994 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493728+0000", 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00068753100000000001 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493809+0000", 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0947999999999998e-05 2024-09-17T16:42:43.902 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:298 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 20.376273180999998, 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011840491999999999, 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.903 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 298 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484355+0000", 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0249999999999999e-06 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484537+0000", 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018172699999999999 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484548+0000", 2024-09-17T16:42:43.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1202999999999999e-05 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484555+0000", 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4839999999999998e-06 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489700+0000", 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051447760000000002 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489765+0000", 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4311000000000001e-05 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.490228+0000", 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046323600000000001 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493079+0000", 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028515580000000001 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496152+0000", 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030726970000000001 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496195+0000", 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2475000000000002e-05 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.908 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:299 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 20.376054916000001, 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01186708, 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 299 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.909 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484573+0000", 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2399999999999998e-07 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484576+0000", 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4920000000000002e-06 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484582+0000", 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.096e-06 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.911 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484587+0000", 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2390000000000002e-06 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492444+0000", 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078571289999999992 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492500+0000", 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5806000000000001e-05 2024-09-17T16:42:43.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492763+0000", 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00026361899999999998 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493177+0000", 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041339600000000001 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:43.913 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496387+0000", 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032098970000000002 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496439+0000", 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2781999999999997e-05 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.914 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:300 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 20.376031883, 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012900164, 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 300 2024-09-17T16:42:43.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484596+0000", 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.63e-07 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484599+0000", 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1690000000000001e-06 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484607+0000", 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484612+0000", 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1379999999999998e-06 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492930+0000", 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083180240000000003 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492979+0000", 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9021999999999999e-05 2024-09-17T16:42:43.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496702+0000", 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037230459999999998 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496783+0000", 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1225999999999998e-05 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.497495+0000", 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00071229699999999997 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.611938+0000", 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.248689584999999, 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006585296, 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.920 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611938+0000", 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611938+0000", 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.611939+0000", 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8299999999999995e-07 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612296+0000", 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00035731800000000002 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612312+0000", 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5815e-05 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612321+0000", 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5789999999999993e-06 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612509+0000", 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018813599999999999 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.612519+0000", 2024-09-17T16:42:43.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5589999999999994e-06 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618487+0000", 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059682199999999998 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618523+0000", 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5785999999999999e-05 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.348762727, 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094427290000000004, 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:42:43.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511865+0000", 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4000000000000001e-07 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511882+0000", 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6923e-05 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511889+0000", 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9609999999999999e-06 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511895+0000", 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8889999999999996e-06 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.927 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511967+0000", 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1373999999999998e-05 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511978+0000", 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1080999999999999e-05 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521259+0000", 2024-09-17T16:42:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092809539999999992 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521307+0000", 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8406999999999999e-05 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=60'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:42:43.929 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.346971312000001, 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083410159999999997, 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:42:43.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513657+0000", 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4200000000000005e-07 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513684+0000", 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7339999999999999e-05 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513698+0000", 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3611000000000001e-05 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513706+0000", 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6829999999999997e-06 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513924+0000", 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000217359 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513939+0000", 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5177000000000001e-05 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521961+0000", 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080218340000000003 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521997+0000", 2024-09-17T16:42:43.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6170000000000001e-05 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.270698092, 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010035229, 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589930+0000", 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.105e-06 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590524+0000", 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059383899999999998 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590544+0000", 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0292000000000002e-05 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590555+0000", 2024-09-17T16:42:43.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0344e-05 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590629+0000", 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4610000000000006e-05 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590640+0000", 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0969e-05 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599920+0000", 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092792629999999994 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599964+0000", 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4807e-05 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:43.938 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.594829+0000", 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.265798091000001, 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068391770000000001, 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594829+0000", 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594829+0000", 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594830+0000", 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9800000000000003e-07 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595169+0000", 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00033882200000000002 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595186+0000", 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6880000000000001e-05 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595195+0000", 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2639999999999997e-06 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595660+0000", 2024-09-17T16:42:43.941 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046495500000000002 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595671+0000", 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0859999999999999e-05 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601636+0000", 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059654790000000001 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.942 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601668+0000", 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2119000000000002e-05 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=50, reqid=client.4553.0:456, at_version=60'44, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.262151025, 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007014335, 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.943 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.944 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598477+0000", 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598555+0000", 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8207000000000005e-05 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598570+0000", 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4885000000000001e-05 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598579+0000", 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0000000000000002e-06 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600037+0000", 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014582600000000001 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600047+0000", 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6010000000000001e-06 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.605456+0000", 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054086220000000001 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.605491+0000", 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.489e-05 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.947 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 61/34 ECSubWrite(tid=30, reqid=osd.11.0:30, at_version=61'24, trim_to=0'0, roll_forward_to=60'22))", 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3469099940000007, 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068967539999999997, 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.948 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513718+0000", 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8500000000000002e-07 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513739+0000", 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1386000000000002e-05 2024-09-17T16:42:43.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513747+0000", 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2700000000000004e-06 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513755+0000", 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5490000000000001e-06 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513812+0000", 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6907999999999998e-05 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513819+0000", 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1760000000000004e-06 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520574+0000", 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067552089999999999 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520614+0000", 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9971000000000001e-05 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 61/34 ECSubWrite(tid=70, reqid=osd.14.0:70, at_version=61'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.514010+0000", 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 9.3466167769999995, 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006612639, 2024-09-17T16:42:43.952 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514010+0000", 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514010+0000", 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514011+0000", 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5000000000000002e-07 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514027+0000", 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514037+0000", 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5789999999999993e-06 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514043+0000", 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6950000000000003e-06 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514096+0000", 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2386000000000003e-05 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514104+0000", 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4030000000000007e-06 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520595+0000", 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064905190000000001 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520623+0000", 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8272e-05 2024-09-17T16:42:43.956 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 62/34 ECSubWrite(tid=75, reqid=osd.14.0:75, at_version=62'47, trim_to=0'0, roll_forward_to=61'43))", 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.4140221900000007, 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078703769999999996, 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446606+0000", 2024-09-17T16:42:43.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0690000000000001e-06 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446635+0000", 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8538999999999999e-05 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446647+0000", 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2617e-05 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446656+0000", 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4700000000000002e-06 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.447766+0000", 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001110516 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.447778+0000", 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1338999999999999e-05 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.454450+0000", 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066719530000000004 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.454475+0000", 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5874e-05 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s4 62/34 ECSubWrite(tid=48, reqid=osd.8.0:48, at_version=62'40, trim_to=0'0, roll_forward_to=61'36))", 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.4111559259999993, 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074745189999999998, 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449472+0000", 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9299999999999998e-07 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449495+0000", 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3354e-05 2024-09-17T16:42:43.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449505+0000", 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9210000000000004e-06 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449513+0000", 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6939999999999995e-06 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:43.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.450155+0000", 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064195400000000003 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.450164+0000", 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5959999999999993e-06 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.456910+0000", 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067456679999999998 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:43.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.456946+0000", 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5738999999999998e-05 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:43.966 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:43.968 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:43.968 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:43.965+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:44.068 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:44.066+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:44.076 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:44.076 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:44.076 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:44.076 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:44.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:44.169 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:44.167+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:44.191 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:44.191 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:44.191 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:44.192 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:44.192 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:44.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:44.271 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:44.269+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:209 3.6s0 3:6d4c68b4:::smithi18337221-35:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.855352912000001, 2024-09-17T16:42:44.349 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019587552000000001, 2024-09-17T16:42:44.350 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.350 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.350 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.350 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.350 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.350 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.351 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 209 2024-09-17T16:42:44.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.351 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490471+0000", 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.492e-06 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490480+0000", 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490502+0000", 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2005e-05 2024-09-17T16:42:44.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490512+0000", 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0129000000000001e-05 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490586+0000", 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4232000000000003e-05 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490679+0000", 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2909000000000001e-05 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497687+0000", 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070084520000000001 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506016+0000", 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0083282830000000006 2024-09-17T16:42:44.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509967+0000", 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039514509999999999 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510056+0000", 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8918000000000005e-05 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:210 3.6s0 3:6d4c68b4:::smithi18337221-35:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490537+0000", 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.855284259000001, 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014546737000000001, 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.357 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 210 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490537+0000", 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490537+0000", 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490538+0000", 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0299999999999998e-07 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490542+0000", 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6739999999999999e-06 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490553+0000", 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1688999999999999e-05 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490560+0000", 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0530000000000001e-06 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491012+0000", 2024-09-17T16:42:44.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045173499999999998 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491062+0000", 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9969000000000002e-05 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504876+0000", 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013814214 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504982+0000", 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010611 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505084+0000", 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010149000000000001 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:44.362 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.855187137000001, 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018101223999999999, 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490635+0000", 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492045+0000", 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001410644 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492086+0000", 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0726999999999998e-05 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492098+0000", 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2163e-05 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492226+0000", 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012778900000000001 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492241+0000", 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4932e-05 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508691+0000", 2024-09-17T16:42:44.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016449693000000001 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508735+0000", 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4768999999999998e-05 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:221 3.6s0 3:6f1c8401:::smithi18337221-16:head [copy-from ver 2] snapc 4=[4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:42:44.367 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.874551705000002, 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014566234000000001, 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 221 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471271+0000", 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1039999999999999e-06 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471276+0000", 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.378e-06 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471289+0000", 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2612999999999999e-05 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471301+0000", 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2046e-05 2024-09-17T16:42:44.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471355+0000", 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4512999999999998e-05 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471361+0000", 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0549999999999996e-06 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475700+0000", 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004338789 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475828+0000", 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012755000000000001 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.481497+0000", 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056689610000000001 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483484+0000", 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019870399999999998 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.485768+0000", 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022843389999999998 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.485836+0000", 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7846000000000001e-05 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:222 3.6s0 3:6f1c8401:::smithi18337221-16:head [stat] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.471318+0000", 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.874503053000002, 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011886663, 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 222 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471318+0000", 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471318+0000", 2024-09-17T16:42:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471319+0000", 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8899999999999999e-07 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471322+0000", 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.88e-06 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471330+0000", 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2600000000000005e-06 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471336+0000", 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8690000000000001e-06 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471400+0000", 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4542999999999995e-05 2024-09-17T16:42:44.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471407+0000", 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4219999999999997e-06 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.476024+0000", 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004617487 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.476081+0000", 2024-09-17T16:42:44.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6563e-05 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483052+0000", 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069706120000000002 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483135+0000", 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3628999999999995e-05 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483205+0000", 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9808999999999995e-05 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:372 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~507904] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.833127309, 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017260719000000001, 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.380 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 372 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512696+0000", 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8700000000000001e-06 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513289+0000", 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059281000000000004 2024-09-17T16:42:44.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513305+0000", 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6494000000000002e-05 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513312+0000", 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5889999999999999e-06 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513379+0000", 2024-09-17T16:42:44.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6659e-05 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513491+0000", 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011233199999999999 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514868+0000", 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001377407 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.525432+0000", 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010563863 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529881+0000", 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044490329999999998 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529955+0000", 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3662e-05 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.385 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:373 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~507904] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.516084+0000", 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.829737333000001, 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014085924, 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.386 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 373 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.516084+0000", 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.516084+0000", 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.516086+0000", 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.871e-06 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.516586+0000", 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00050053999999999995 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.516603+0000", 2024-09-17T16:42:44.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6849000000000001e-05 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.516612+0000", 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8459999999999997e-06 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.520544+0000", 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003932166 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.520647+0000", 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000102192 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.521726+0000", 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001079258 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529027+0000", 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073010749999999998 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.530119+0000", 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001091786 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.530170+0000", 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1341000000000002e-05 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.391 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:374 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~262144] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.518086+0000", 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.827735118, 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012308754999999999, 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 374 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.392 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518086+0000", 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518086+0000", 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518088+0000", 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.392e-06 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518364+0000", 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027608899999999998 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518379+0000", 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5308999999999999e-05 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518397+0000", 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8230999999999999e-05 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.525537+0000", 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071400459999999997 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.525596+0000", 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8559e-05 2024-09-17T16:42:44.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.526058+0000", 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00046208099999999998 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529028+0000", 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00296985 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.530353+0000", 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013247319999999999 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.530395+0000", 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2466000000000003e-05 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:375 3.6s0 3:636772f7:::smithi18337221-13:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.397 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.518413+0000", 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.827408073000001, 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014554505000000001, 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 375 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518413+0000", 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518413+0000", 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518414+0000", 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9599999999999999e-07 2024-09-17T16:42:44.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518423+0000", 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4180000000000003e-06 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518433+0000", 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0960000000000007e-06 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518443+0000", 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0175e-05 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.528287+0000", 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0098439870000000002 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.528398+0000", 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000110999 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.528735+0000", 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033758600000000002 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529271+0000", 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053594799999999996 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.532914+0000", 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003642625 2024-09-17T16:42:44.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.532968+0000", 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3974999999999997e-05 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:376 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.827369857000001, 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015816857, 2024-09-17T16:42:44.403 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 376 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.06e-07 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518456+0000", 2024-09-17T16:42:44.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6679999999999999e-06 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518474+0000", 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8652e-05 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518481+0000", 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2920000000000001e-06 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529124+0000", 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010643556 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529173+0000", 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8321e-05 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533229+0000", 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040568990000000001 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533274+0000", 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5016999999999999e-05 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.534268+0000", 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00099394599999999989 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:394 3.6s0 3:6f1c8401:::smithi18337221-16:head [append 0~557056] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.605240+0000", 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.740580901, 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014263260999999999, 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 394 2024-09-17T16:42:44.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605240+0000", 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605240+0000", 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605242+0000", 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.621e-06 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605686+0000", 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000444158 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605703+0000", 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6841999999999999e-05 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605712+0000", 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2799999999999992e-06 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605770+0000", 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7646999999999999e-05 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.605842+0000", 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2126999999999996e-05 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.606553+0000", 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000710729 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619207+0000", 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012654133999999999 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619436+0000", 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00022912599999999999 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619504+0000", 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7596999999999997e-05 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:395 3.6s0 3:6f1c8401:::smithi18337221-16:head [append 0~671744] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.609398+0000", 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.736423235, 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011465952999999999, 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 395 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.609398+0000", 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.609398+0000", 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.609399+0000", 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.079e-06 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.609994+0000", 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059440100000000004 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610007+0000", 2024-09-17T16:42:44.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3794e-05 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610019+0000", 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1905e-05 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610237+0000", 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000218113 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610362+0000", 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000124783 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.611357+0000", 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00099456700000000002 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619208+0000", 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078515270000000005 2024-09-17T16:42:44.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.620788+0000", 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015795239999999999 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.620864+0000", 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6260000000000005e-05 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:396 3.6s0 3:6f1c8401:::smithi18337221-16:head [append 0~98304] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610119+0000", 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.73570217, 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014839274, 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.421 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 396 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610119+0000", 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610119+0000", 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610120+0000", 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1680000000000001e-06 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610226+0000", 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010588 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610236+0000", 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0163000000000001e-05 2024-09-17T16:42:44.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610242+0000", 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.242e-06 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.617957+0000", 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077157700000000003 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.618044+0000", 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6972999999999996e-05 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.618441+0000", 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039642699999999998 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619605+0000", 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164296 2024-09-17T16:42:44.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.624914+0000", 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00530921 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.624959+0000", 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4144999999999998e-05 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.426 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:397 3.6s0 3:6f1c8401:::smithi18337221-16:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.735564713, 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015018178, 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 397 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610260+0000", 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2189999999999998e-06 2024-09-17T16:42:44.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610263+0000", 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9380000000000002e-06 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610267+0000", 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8689999999999997e-06 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619735+0000", 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0094680600000000004 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619840+0000", 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104749 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.620351+0000", 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00051100899999999999 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.620941+0000", 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058999900000000001 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625182+0000", 2024-09-17T16:42:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042407169999999998 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625275+0000", 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3015000000000003e-05 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:398 3.6s0 3:6f1c8401:::smithi18337221-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.433 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.735548694, 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015904456000000001, 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 398 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4400000000000001e-07 2024-09-17T16:42:44.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610275+0000", 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0490000000000002e-06 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610279+0000", 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7570000000000002e-06 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610282+0000", 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4139999999999998e-06 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621112+0000", 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010829319 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621164+0000", 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2238999999999999e-05 2024-09-17T16:42:44.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625667+0000", 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0045036399999999997 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625718+0000", 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0970000000000002e-05 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.626177+0000", 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045872399999999998 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:454 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~655360] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.587870+0000", 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.75795181, 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013426911, 2024-09-17T16:42:44.439 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 454 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.587870+0000", 2024-09-17T16:42:44.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.587870+0000", 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.587872+0000", 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4169999999999999e-06 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.588740+0000", 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00086751700000000005 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.588754+0000", 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4025e-05 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.588759+0000", 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.789e-06 2024-09-17T16:42:44.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.588812+0000", 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2818000000000002e-05 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.588882+0000", 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9898000000000001e-05 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.589553+0000", 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067122299999999998 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599189+0000", 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096357419999999992 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.601243+0000", 2024-09-17T16:42:44.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0020537300000000001 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.601296+0000", 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3752000000000003e-05 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:455 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~638976] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.591364+0000", 2024-09-17T16:42:44.445 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.754457395999999, 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011214253, 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 455 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.591364+0000", 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.591364+0000", 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.591365+0000", 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1090000000000001e-06 2024-09-17T16:42:44.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592181+0000", 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000815491 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592194+0000", 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3685e-05 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592200+0000", 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9880000000000001e-06 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.593584+0000", 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0013836409999999999 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.593655+0000", 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0710000000000006e-05 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.594277+0000", 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00062213800000000005 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599824+0000", 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055476450000000004 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.602535+0000", 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0027105290000000002 2024-09-17T16:42:44.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.602578+0000", 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3316999999999999e-05 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:456 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~131072] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.592213+0000", 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.753607945000001, 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013585616999999999, 2024-09-17T16:42:44.451 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 456 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592213+0000", 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592213+0000", 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592214+0000", 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8500000000000002e-07 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592295+0000", 2024-09-17T16:42:44.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1110000000000001e-05 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592303+0000", 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7970000000000001e-06 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592307+0000", 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0400000000000003e-06 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.597793+0000", 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0054860170000000002 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.597866+0000", 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3054999999999998e-05 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.598253+0000", 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038670499999999999 2024-09-17T16:42:44.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599897+0000", 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0016444299999999999 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.605754+0000", 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058569169999999997 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.605799+0000", 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5061000000000001e-05 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:457 3.6s0 3:636772f7:::smithi18337221-13:head [setxattr _header (57) in=7b] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.592315+0000", 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.753506007, 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013652607000000001, 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.457 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 457 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592315+0000", 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592315+0000", 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592316+0000", 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.46e-07 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592318+0000", 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9769999999999999e-06 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592322+0000", 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5900000000000001e-06 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592325+0000", 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0070000000000002e-06 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599220+0000", 2024-09-17T16:42:44.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068943370000000004 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599282+0000", 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2576999999999994e-05 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599592+0000", 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031005799999999999 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.600030+0000", 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00043765399999999999 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.605915+0000", 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058846619999999997 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.605968+0000", 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3298999999999999e-05 2024-09-17T16:42:44.462 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:458 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.753491761999999, 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014907866000000001, 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.463 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 458 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:42:44.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7799999999999997e-07 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592331+0000", 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3680000000000001e-06 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592336+0000", 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0150000000000003e-06 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592339+0000", 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0149999999999999e-06 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599765+0000", 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00742605 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599818+0000", 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2621999999999999e-05 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.606231+0000", 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0064125739999999999 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.606284+0000", 2024-09-17T16:42:44.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3001000000000003e-05 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.607238+0000", 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00095394299999999996 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.468 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:44.470 INFO:tasks.rados.rados.0.smithi183.stdout:216: done (2 left) 2024-09-17T16:42:44.470 INFO:tasks.rados.rados.0.smithi183.stdout:217: done (1 left) 2024-09-17T16:42:44.470 INFO:tasks.rados.rados.0.smithi183.stdout:218: done (0 left) 2024-09-17T16:42:44.470 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 30 current snap is 19 2024-09-17T16:42:44.471 INFO:tasks.rados.rados.0.smithi183.stdout:219: seq_num 94 ranges {491520=425984,917504=786432,1703936=376832} 2024-09-17T16:42:44.471 INFO:tasks.rados.rados.0.smithi183.stdout:219: writing smithi18337221-30 from 491520 to 917504 tid 1 2024-09-17T16:42:44.471 INFO:tasks.rados.rados.0.smithi183.stdout:219: writing smithi18337221-30 from 917504 to 1703936 tid 2 2024-09-17T16:42:44.471 INFO:tasks.rados.rados.0.smithi183.stdout:219: writing smithi18337221-30 from 1703936 to 2080768 tid 3 2024-09-17T16:42:44.471 INFO:tasks.rados.rados.0.smithi183.stdout:220: snap_remove snap 14 2024-09-17T16:42:44.471 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:44.467+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:44.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:44.472 INFO:teuthology.orchestra.run.smithi060.stderr:set 2.4 pg_upmap mapping to [11,4] 2024-09-17T16:42:44.473 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:42:44.571 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:44.569+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:44.620 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:44.620 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:44.620 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:44.620 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:44.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:44.672 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:44.670+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:44.736 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:44.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:44.736 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:44.736 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:44.736 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:44.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:44.788 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:44.786+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:44.853 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:44.853 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:44.853 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:44.853 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:44.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.853 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.374589745000002, 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.855 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:44.857 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:42:44.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:42:44.859 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.860 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.372656992, 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.861 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:42:44.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:42:44.863 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:42:44.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.865 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:42:44.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.372230000999998, 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:42:44.867 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:44.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:42:44.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.873 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.372196537000001, 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:44.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.880 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.372150230999999, 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:42:44.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.884 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:42:44.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:42:44.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.372090377999999, 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.887 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:42:44.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:44.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.5.23:2 3.bs0 3:d08ffbb6:::smithi18337221-30:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.366819936999999, 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025206989999999999, 2024-09-17T16:42:44.893 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483332+0000", 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9630000000000001e-06 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483339+0000", 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483351+0000", 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:42:44.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483359+0000", 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506020+0000", 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022660777 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506121+0000", 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010158999999999999 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508537+0000", 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002415848 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.362159770000002, 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016316462, 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:44.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487992+0000", 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1400000000000001e-06 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487999+0000", 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1459999999999999e-06 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488012+0000", 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3499000000000001e-05 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488021+0000", 2024-09-17T16:42:44.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6519999999999995e-06 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504215+0000", 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016193754000000001 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504307+0000", 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2270999999999998e-05 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:213 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.359490224999998, 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017648329000000001, 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 213 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490661+0000", 2024-09-17T16:42:44.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490665+0000", 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1010000000000002e-06 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490675+0000", 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0467e-05 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490681+0000", 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8939999999999998e-06 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492163+0000", 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001481794 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492244+0000", 2024-09-17T16:42:44.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0897999999999997e-05 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508308+0000", 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016064544 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:295 3.bs0 3:d855b096:::smithi18337221-24:head [copy-from ver 7] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.384857352000001, 2024-09-17T16:42:44.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016204202000000001, 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 295 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465294+0000", 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.451e-06 2024-09-17T16:42:44.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465300+0000", 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6659999999999996e-06 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465314+0000", 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4443e-05 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465322+0000", 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.52e-06 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465665+0000", 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034335499999999999 2024-09-17T16:42:44.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465770+0000", 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104732 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473519+0000", 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077493609999999997 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479834+0000", 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063149369999999996 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481444+0000", 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0016096330000000001 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481497+0000", 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3103999999999998e-05 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:351 3.7s0 3:e31d051c:::smithi18337221-15:head [copy-from ver 8] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.370672446, 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023291879000000001, 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.913 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 351 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479479+0000", 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.671e-06 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479487+0000", 2024-09-17T16:42:44.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.763e-06 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479504+0000", 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6891000000000001e-05 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479513+0000", 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0690000000000008e-06 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479567+0000", 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3599e-05 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479657+0000", 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9906000000000003e-05 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.493160+0000", 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013503724999999999 2024-09-17T16:42:44.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.500514+0000", 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073532679999999996 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502657+0000", 2024-09-17T16:42:44.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002143407 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502770+0000", 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011258 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:352 3.7s0 3:e31d051c:::smithi18337221-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.370617996, 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020327753, 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 352 2024-09-17T16:42:44.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479533+0000", 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3200000000000005e-07 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479537+0000", 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.403e-06 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479548+0000", 2024-09-17T16:42:44.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0444e-05 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479555+0000", 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0559999999999999e-06 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479795+0000", 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023998499999999999 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479858+0000", 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2729000000000002e-05 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499619+0000", 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019761535 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499738+0000", 2024-09-17T16:42:44.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118867 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499860+0000", 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012210199999999999 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:433 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~622592] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:44.925 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.334630361, 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019410863, 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 433 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515522+0000", 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8160000000000001e-06 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516965+0000", 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014435629999999999 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516981+0000", 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5681000000000001e-05 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516991+0000", 2024-09-17T16:42:44.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8239999999999995e-06 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517069+0000", 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8172999999999998e-05 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517201+0000", 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000132101 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518296+0000", 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010954490000000001 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532966+0000", 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014669013 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534841+0000", 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018757509999999999 2024-09-17T16:42:44.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534931+0000", 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9492000000000003e-05 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:434 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~475136] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:44.931 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.331237968, 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017119724999999999, 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 434 2024-09-17T16:42:44.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:44.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518914+0000", 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519590+0000", 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067595600000000002 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519604+0000", 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4391e-05 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519613+0000", 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4179999999999997e-06 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.524975+0000", 2024-09-17T16:42:44.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053627240000000001 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.525091+0000", 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115345 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.526035+0000", 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00094401900000000004 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533023+0000", 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069880280000000003 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.535985+0000", 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029618489999999999 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.536032+0000", 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7379000000000002e-05 2024-09-17T16:42:44.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:435 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~294912] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.329288304, 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018146874, 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 435 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:44.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520863+0000", 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4050000000000001e-06 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521158+0000", 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029489000000000002 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521173+0000", 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5228000000000001e-05 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521184+0000", 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0332999999999999e-05 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529465+0000", 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082808810000000004 2024-09-17T16:42:44.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529536+0000", 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.161e-05 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.530071+0000", 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053491699999999999 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533025+0000", 2024-09-17T16:42:44.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002953401 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.538970+0000", 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059453010000000001 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539009+0000", 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8908000000000001e-05 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:436 3.1s0 3:845a4d43:::smithi18337221-2:head [setxattr _header (56) in=7b] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.328951851999999, 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017989387999999999, 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 436 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.944 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521199+0000", 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9999999999999997e-07 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521213+0000", 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4215e-05 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521223+0000", 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9340000000000001e-06 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521229+0000", 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0329999999999997e-06 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532021+0000", 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010791558 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532136+0000", 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115529 2024-09-17T16:42:44.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532681+0000", 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054450799999999997 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533396+0000", 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071506499999999997 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539125+0000", 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057293409999999998 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539188+0000", 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2504999999999999e-05 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:437 3.1s0 3:845a4d43:::smithi18337221-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:44.949 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 11.328910841999999, 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018905465, 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 437 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521240+0000", 2024-09-17T16:42:44.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521242+0000", 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.43e-06 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521251+0000", 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4910000000000005e-06 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521256+0000", 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0629999999999996e-06 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533246+0000", 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011990466999999999 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533313+0000", 2024-09-17T16:42:44.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7045999999999995e-05 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539424+0000", 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061101920000000004 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539475+0000", 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1892999999999999e-05 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.540145+0000", 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00066938200000000005 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:540 3.bs0 3:d08ffbb6:::smithi18337221-30:head [append 0~425984] snapc 14=[14,13,10,f] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.450934+0000", 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.39921596599999998, 2024-09-17T16:42:44.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017124098000000001, 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 540 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.450934+0000", 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.450934+0000", 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.450937+0000", 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9979999999999999e-06 2024-09-17T16:42:44.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451410+0000", 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047251500000000001 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451436+0000", 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6353999999999999e-05 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451446+0000", 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7710000000000001e-06 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451531+0000", 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5223999999999996e-05 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:44.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451541+0000", 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4150000000000005e-06 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.453780+0000", 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002238978 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.453901+0000", 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121626 2024-09-17T16:42:44.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.454995+0000", 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010940640000000001 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467722+0000", 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012726922 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467987+0000", 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026504700000000003 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.468058+0000", 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1184000000000002e-05 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:543 3.bs0 3:d08ffbb6:::smithi18337221-30:head [setxattr _header (57) in=7b] snapc 14=[14,13,10,f] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:42:44.962 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.458073+0000", 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.39207730499999999, 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017073801, 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 543 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458073+0000", 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458073+0000", 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458074+0000", 2024-09-17T16:42:44.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458077+0000", 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6610000000000002e-06 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458086+0000", 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3960000000000006e-06 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458094+0000", 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7209999999999994e-06 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.471663+0000", 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013569505000000001 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.471718+0000", 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5074999999999997e-05 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.472136+0000", 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041782700000000001 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.472701+0000", 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00056461 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:44.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475053+0000", 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002352392 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475147+0000", 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3756000000000002e-05 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:544 3.bs0 3:d08ffbb6:::smithi18337221-30:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.39204731799999998, 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018041647000000001, 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 544 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.969 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458104+0000", 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8299999999999996e-07 2024-09-17T16:42:44.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458106+0000", 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6139999999999999e-06 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458117+0000", 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0536e-05 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458122+0000", 2024-09-17T16:42:44.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5099999999999998e-06 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.473227+0000", 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015105084 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.473280+0000", 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2886999999999997e-05 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475521+0000", 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022407680000000002 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475616+0000", 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4841999999999998e-05 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.476145+0000", 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052872300000000004 2024-09-17T16:42:44.973 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:44.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:44.974 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:44.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:44.976 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:44.973+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:45.076 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:45.074+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:45.126 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:45.126 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:45.126 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:45.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:45.177 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:45.176+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:45.241 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:45.241 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:45.241 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:45.241 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:45.241 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:45.250 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:45.278 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:45.276+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:45.357 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:178 3.4s0 3:216603c8:::smithi18337221-7:head [copy-from ver 2] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.894484028999997, 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0097627789999999992, 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.358 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 178 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.359 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460520+0000", 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3209999999999999e-06 2024-09-17T16:42:45.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460526+0000", 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4590000000000003e-06 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460539+0000", 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2634e-05 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460546+0000", 2024-09-17T16:42:45.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0450000000000003e-06 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460588+0000", 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1984999999999999e-05 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460652+0000", 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4475999999999997e-05 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.466465+0000", 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058132269999999998 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469088+0000", 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026224709999999999 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470220+0000", 2024-09-17T16:42:45.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001132248 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470281+0000", 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0912999999999998e-05 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:179 3.4s0 3:216603c8:::smithi18337221-7:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.894443924999997, 2024-09-17T16:42:45.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084466430000000002, 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 179 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:45.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460558+0000", 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460559+0000", 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6800000000000001e-07 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460562+0000", 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5410000000000001e-06 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460569+0000", 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2160000000000003e-06 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460576+0000", 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1230000000000002e-06 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460781+0000", 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00020571599999999999 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460810+0000", 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8632999999999998e-05 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468798+0000", 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0079879180000000001 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.468900+0000", 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000101611 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469005+0000", 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105417 2024-09-17T16:42:45.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:199 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 764485~497083,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.877188175000001, 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010265850999999999, 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:45.370 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 199 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:45.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477816+0000", 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8530000000000001e-06 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477825+0000", 2024-09-17T16:42:45.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8850000000000005e-06 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477841+0000", 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6070999999999999e-05 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477851+0000", 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0261999999999999e-05 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477947+0000", 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5457000000000004e-05 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477956+0000", 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9639999999999992e-06 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480792+0000", 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028365840000000001 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480879+0000", 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7130000000000001e-05 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488080+0000", 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072006450000000003 2024-09-17T16:42:45.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:200 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.877122923000002, 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011662507000000001, 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.376 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 200 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477880+0000", 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8599999999999998e-07 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477886+0000", 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5740000000000001e-06 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477906+0000", 2024-09-17T16:42:45.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9604000000000001e-05 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477914+0000", 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5859999999999999e-06 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478028+0000", 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011431500000000001 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478034+0000", 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0530000000000003e-06 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481597+0000", 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035624699999999999 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481685+0000", 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8129999999999998e-05 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489542+0000", 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078571890000000005 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:201 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.877073257999999, 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013839093, 2024-09-17T16:42:45.381 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 201 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477930+0000", 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1189999999999999e-06 2024-09-17T16:42:45.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477949+0000", 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1701e-05 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477955+0000", 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6529999999999997e-06 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121858 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478083+0000", 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7150000000000003e-06 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482035+0000", 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039517290000000002 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482114+0000", 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9499000000000006e-05 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491768+0000", 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096540259999999996 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:45.386 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.873414864000001, 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082527759999999999, 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481587+0000", 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481588+0000", 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.41e-07 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481637+0000", 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9536999999999997e-05 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481649+0000", 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1718e-05 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481658+0000", 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0589999999999992e-06 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482410+0000", 2024-09-17T16:42:45.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00075179700000000001 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482422+0000", 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1980999999999999e-05 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489809+0000", 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073877420000000001 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489840+0000", 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0701000000000003e-05 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.872244783999999, 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071068959999999997, 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.391 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482757+0000", 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482758+0000", 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482780+0000", 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1294e-05 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482790+0000", 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0736e-05 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482801+0000", 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0474e-05 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482990+0000", 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00018943399999999999 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483000+0000", 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4259999999999992e-06 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489844+0000", 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068445470000000003 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489864+0000", 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9993999999999999e-05 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.395 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.871801920999999, 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066866139999999996, 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.396 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483200+0000", 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483201+0000", 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1090000000000001e-06 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483218+0000", 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6175999999999999e-05 2024-09-17T16:42:45.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483230+0000", 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2149e-05 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483236+0000", 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4740000000000002e-06 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483520+0000", 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028360700000000001 2024-09-17T16:42:45.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483531+0000", 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489867+0000", 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063354129999999998 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489887+0000", 2024-09-17T16:42:45.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0285e-05 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.861614374999998, 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096456860000000005, 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.400 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493389+0000", 2024-09-17T16:42:45.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.057e-06 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495399+0000", 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002010529 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495410+0000", 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0983e-05 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495418+0000", 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0120000000000005e-06 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495585+0000", 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000166274 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495592+0000", 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5580000000000003e-06 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502976+0000", 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073836580000000004 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503034+0000", 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7615000000000003e-05 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.404 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.893866176, 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010978876, 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462292+0000", 2024-09-17T16:42:45.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001155611 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462308+0000", 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6039e-05 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462318+0000", 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3989999999999993e-06 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462380+0000", 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2589999999999995e-05 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462390+0000", 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0020999999999999e-05 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472076+0000", 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096855420000000001 2024-09-17T16:42:45.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472115+0000", 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9242999999999997e-05 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.2.22:1 3.4s0 3:2e95bc92:::smithi18337221-17:head [assert-version v4,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.481477+0000", 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.873525570999998, 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0067034039999999996, 2024-09-17T16:42:45.409 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481477+0000", 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481477+0000", 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481479+0000", 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.863e-06 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481487+0000", 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.303e-06 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481501+0000", 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3943e-05 2024-09-17T16:42:45.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481510+0000", 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9949999999999994e-06 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481590+0000", 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9825000000000002e-05 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:45.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.481597+0000", 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5059999999999998e-06 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.483814+0000", 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022168359999999998 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.483916+0000", 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000101928 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.488180+0000", 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042642050000000001 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.858621951, 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013323026999999999, 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.414 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496381+0000", 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496856+0000", 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047436000000000001 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496867+0000", 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.165e-05 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496876+0000", 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8650000000000007e-06 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496951+0000", 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4673999999999997e-05 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496961+0000", 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.048e-05 2024-09-17T16:42:45.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012637884 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509703+0000", 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104149 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.856090603999998, 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072169349999999998, 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.498912+0000", 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6700000000000002e-07 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499364+0000", 2024-09-17T16:42:45.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045188699999999999 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499381+0000", 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6317999999999999e-05 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499389+0000", 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1960000000000008e-06 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499456+0000", 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7556000000000002e-05 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499465+0000", 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1799999999999996e-06 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506091+0000", 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066263529999999998 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506129+0000", 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7577999999999998e-05 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.502725+0000", 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.852276959000001, 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085945380000000005, 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502725+0000", 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502725+0000", 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502726+0000", 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8199999999999999e-07 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503293+0000", 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00056727899999999996 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503306+0000", 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2724e-05 2024-09-17T16:42:45.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503314+0000", 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0539999999999995e-06 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503377+0000", 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2874999999999997e-05 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503386+0000", 2024-09-17T16:42:45.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3729999999999999e-06 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511283+0000", 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00789662 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511320+0000", 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6831e-05 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.427 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.849220294999999, 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088565450000000004, 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505783+0000", 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2600000000000001e-07 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506045+0000", 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026176500000000001 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506148+0000", 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000102982 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506157+0000", 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9840000000000007e-06 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506467+0000", 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00030994099999999999 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506482+0000", 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5934999999999999e-05 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514604+0000", 2024-09-17T16:42:45.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0081217470000000003 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514638+0000", 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4264999999999998e-05 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:384 3.4s0 3:2e95bc92:::smithi18337221-17:head [rollback 8] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:45.432 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.764875453999998, 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065397579999999997, 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 384 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590127+0000", 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590130+0000", 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.852e-06 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590138+0000", 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7959999999999996e-06 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590143+0000", 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5249999999999996e-06 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.591414+0000", 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012708870000000001 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.591497+0000", 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2565999999999995e-05 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.591861+0000", 2024-09-17T16:42:45.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00036452700000000002 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592875+0000", 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010132170000000001 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596612+0000", 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.003737888 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596667+0000", 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4098000000000003e-05 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:385 3.4s0 3:2e95bc92:::smithi18337221-17:head [append 0~0] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.764828539, 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066138500000000001, 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.438 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 385 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590174+0000", 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0399999999999996e-07 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590177+0000", 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.914e-06 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590183+0000", 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1689999999999997e-06 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.590189+0000", 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4829999999999999e-06 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592151+0000", 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019623100000000001 2024-09-17T16:42:45.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592227+0000", 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5537000000000005e-05 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.592549+0000", 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00032248800000000001 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.593022+0000", 2024-09-17T16:42:45.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047337600000000002 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596742+0000", 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0037197509999999999 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.596788+0000", 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5318000000000002e-05 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.862594958000001, 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095737730000000007, 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1600000000000001e-07 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493082+0000", 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067486599999999999 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493097+0000", 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4405e-05 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493107+0000", 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0254999999999999e-05 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493184+0000", 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.661e-05 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493194+0000", 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0156000000000001e-05 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501938+0000", 2024-09-17T16:42:45.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087447870000000004 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501981+0000", 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2577999999999998e-05 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/34 ECSubWrite(tid=106, reqid=client.4553.0:401, at_version=56'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.497580+0000", 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.857422333000001, 2024-09-17T16:42:45.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0080438509999999994, 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497580+0000", 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497580+0000", 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497581+0000", 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.015e-06 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497808+0000", 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00022724299999999999 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497821+0000", 2024-09-17T16:42:45.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3139000000000001e-05 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.497828+0000", 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8600000000000004e-06 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498759+0000", 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00093102899999999999 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498772+0000", 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2665e-05 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.505584+0000", 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068122520000000004 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.505624+0000", 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9647999999999997e-05 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.502330+0000", 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.852672106, 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065842970000000002, 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502330+0000", 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502330+0000", 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502331+0000", 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.23e-07 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502672+0000", 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034076700000000001 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502688+0000", 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6286999999999998e-05 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502697+0000", 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6719999999999993e-06 2024-09-17T16:42:45.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502784+0000", 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7158999999999997e-05 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502793+0000", 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4320000000000005e-06 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508872+0000", 2024-09-17T16:42:45.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006078656 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508914+0000", 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2601000000000001e-05 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.457 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:45.459 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:45.456+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:45.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:45.460 INFO:tasks.rados.rados.0.smithi183.stdout:220: done (1 left) 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:221: setattr oid 41 current snap is 19 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: finishing write tid 1 to smithi18337221-30 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: finishing write tid 2 to smithi18337221-30 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: finishing write tid 3 to smithi18337221-30 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: finishing write tid 4 to smithi18337221-30 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: finishing write tid 5 to smithi18337221-30 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: oid 30 updating version 0 to 88 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: oid 30 version 88 is already newer than 87 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: oid 30 version 88 is already newer than 86 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: oid 30 updating version 88 to 89 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 30 v 89 (ObjNum 94 snap 19 seq_num 94) dirty exists 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: left oid 30 (ObjNum 94 snap 19 seq_num 94) 2024-09-17T16:42:45.461 INFO:tasks.rados.rados.0.smithi183.stdout:219: done (1 left) 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 22 current snap is 19 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:222: seq_num 95 ranges {212992=442368,655360=540672,1196032=622592} 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:222: writing smithi18337221-22 from 212992 to 655360 tid 1 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:222: writing smithi18337221-22 from 655360 to 1196032 tid 2 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:222: writing smithi18337221-22 from 1196032 to 1818624 tid 3 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:223: delete oid 27 current snap is 19 2024-09-17T16:42:45.462 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 41 v 39 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-09-17T16:42:45.465 INFO:tasks.rados.rados.0.smithi183.stdout:221: done (2 left) 2024-09-17T16:42:45.465 INFO:tasks.rados.rados.0.smithi183.stdout:223: done (1 left) 2024-09-17T16:42:45.465 INFO:tasks.rados.rados.0.smithi183.stdout:224: read oid 9 snap 13 2024-09-17T16:42:45.465 INFO:tasks.rados.rados.0.smithi183.stdout:224: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:45.465 INFO:tasks.rados.rados.0.smithi183.stdout:225: rollback oid 14 current snap is 19 2024-09-17T16:42:45.465 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 14 to 18 2024-09-17T16:42:45.466 INFO:tasks.rados.rados.0.smithi183.stdout:226: read oid 24 snap -1 2024-09-17T16:42:45.466 INFO:tasks.rados.rados.0.smithi183.stdout:226: expect (ObjNum 87 snap 14 seq_num 87) 2024-09-17T16:42:45.466 INFO:tasks.rados.rados.0.smithi183.stdout:227: snap_create 2024-09-17T16:42:45.469 INFO:tasks.rados.rados.0.smithi183.stdout:225: finishing rollback tid 0 to smithi18337221-14 2024-09-17T16:42:45.470 INFO:tasks.rados.rados.0.smithi183.stdout:222: finishing write tid 1 to smithi18337221-22 2024-09-17T16:42:45.471 INFO:tasks.rados.rados.0.smithi183.stdout:222: finishing write tid 2 to smithi18337221-22 2024-09-17T16:42:45.472 INFO:tasks.rados.rados.0.smithi183.stdout:225: finishing rollback tid 1 to smithi18337221-14 2024-09-17T16:42:45.472 INFO:tasks.rados.rados.0.smithi183.stdout:225: finishing rollback tid 2 to smithi18337221-14 2024-09-17T16:42:45.472 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 14 v 147 (ObjNum 86 snap 13 seq_num 86) dirty exists 2024-09-17T16:42:45.474 INFO:tasks.rados.rados.0.smithi183.stdout:224: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:42:45.474 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:45.476 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:45.477 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: finishing write tid 3 to smithi18337221-22 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: finishing write tid 4 to smithi18337221-22 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: finishing write tid 5 to smithi18337221-22 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: oid 22 updating version 0 to 35 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: oid 22 updating version 35 to 38 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: oid 22 version 38 is already newer than 37 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: oid 22 version 38 is already newer than 36 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 22 v 38 (ObjNum 95 snap 19 seq_num 95) dirty exists 2024-09-17T16:42:45.479 INFO:tasks.rados.rados.0.smithi183.stdout:222: left oid 22 (ObjNum 95 snap 19 seq_num 95) 2024-09-17T16:42:45.483 INFO:tasks.rados.rados.0.smithi183.stdout:226: expect (ObjNum 87 snap 14 seq_num 87) 2024-09-17T16:42:45.483 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:45.508 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:45.532 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:45.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:45.559 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:45.557+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:45.576 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:45.576 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:45.577 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:45.577 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:45.586 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:45.670 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:45.668+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:45.685 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:45.686 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:45.704 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:45.704 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:45.721 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:45.721 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:45.734 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:45.735 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:45.735 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:45.738 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:45.739 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:45.744 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:45.755 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:45.762 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:45.760+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:45.773 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:45.773 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:45.790 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:45.791 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:45.807 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:45.808 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:45.824 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:45.825 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:45.841 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:45.841 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:45.859 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:45.860 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:45.863 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:45.861+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:45.865 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:45.865 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.380810371000003, 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011223067999999999, 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:45.867 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499999999999999e-07 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482482+0000", 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014705100000000001 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.868 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482496+0000", 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4164e-05 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482513+0000", 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6529e-05 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482631+0000", 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011836999999999999 2024-09-17T16:42:45.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482642+0000", 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0895e-05 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.870 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493489+0000", 2024-09-17T16:42:45.871 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010846876 2024-09-17T16:42:45.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.871 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.871 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493558+0000", 2024-09-17T16:42:45.872 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8827999999999999e-05 2024-09-17T16:42:45.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.873 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:45.873 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:45.873 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.368323105000002, 2024-09-17T16:42:45.873 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082916329999999996, 2024-09-17T16:42:45.874 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.874 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.874 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.875 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.875 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:45.875 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.876 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:45.876 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.876 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.877 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494823+0000", 2024-09-17T16:42:45.877 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.201e-06 2024-09-17T16:42:45.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.877 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.878 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495212+0000", 2024-09-17T16:42:45.878 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038936199999999998 2024-09-17T16:42:45.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.879 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495232+0000", 2024-09-17T16:42:45.879 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9830000000000002e-05 2024-09-17T16:42:45.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.879 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495243+0000", 2024-09-17T16:42:45.880 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0589e-05 2024-09-17T16:42:45.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.880 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.880 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495340+0000", 2024-09-17T16:42:45.881 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6824999999999995e-05 2024-09-17T16:42:45.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.881 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.881 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495350+0000", 2024-09-17T16:42:45.882 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0778000000000001e-05 2024-09-17T16:42:45.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.882 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.882 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503052+0000", 2024-09-17T16:42:45.883 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077014559999999998 2024-09-17T16:42:45.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.883 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.884 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503113+0000", 2024-09-17T16:42:45.884 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1592000000000003e-05 2024-09-17T16:42:45.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.885 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:45.885 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:45.885 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.401583775999999, 2024-09-17T16:42:45.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010954281999999999, 2024-09-17T16:42:45.885 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.886 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:45.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:45.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461562+0000", 2024-09-17T16:42:45.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3300000000000002e-07 2024-09-17T16:42:45.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462055+0000", 2024-09-17T16:42:45.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00049369500000000005 2024-09-17T16:42:45.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462066+0000", 2024-09-17T16:42:45.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1012000000000001e-05 2024-09-17T16:42:45.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462074+0000", 2024-09-17T16:42:45.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1790000000000008e-06 2024-09-17T16:42:45.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462143+0000", 2024-09-17T16:42:45.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8353000000000001e-05 2024-09-17T16:42:45.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462154+0000", 2024-09-17T16:42:45.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0773e-05 2024-09-17T16:42:45.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472429+0000", 2024-09-17T16:42:45.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010275876999999999 2024-09-17T16:42:45.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472515+0000", 2024-09-17T16:42:45.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5859999999999994e-05 2024-09-17T16:42:45.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.896 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:42:45.896 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.473581+0000", 2024-09-17T16:42:45.896 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 22.389563924000001, 2024-09-17T16:42:45.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0060366960000000002, 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473581+0000", 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473581+0000", 2024-09-17T16:42:45.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473582+0000", 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7100000000000011e-07 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473737+0000", 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015486699999999999 2024-09-17T16:42:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473751+0000", 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4474999999999999e-05 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473760+0000", 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3380000000000005e-06 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473823+0000", 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3415000000000002e-05 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473842+0000", 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9262e-05 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479578+0000", 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005735853 2024-09-17T16:42:45.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479618+0000", 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9514999999999997e-05 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 55/34 ECSubWrite(tid=126, reqid=osd.4.0:126, at_version=55'43, trim_to=0'0, roll_forward_to=55'41))", 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.496627+0000", 2024-09-17T16:42:45.903 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.366517793, 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065813779999999997, 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496627+0000", 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496627+0000", 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496628+0000", 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496651+0000", 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3042000000000001e-05 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496663+0000", 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.183e-05 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496671+0000", 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5199999999999997e-06 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496733+0000", 2024-09-17T16:42:45.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2162999999999994e-05 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496742+0000", 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1160000000000005e-06 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503154+0000", 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0064112459999999998 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503208+0000", 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4731999999999997e-05 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:45.908 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.365878735999999, 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012371190000000001, 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497267+0000", 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3900000000000004e-07 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497341+0000", 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4518999999999996e-05 2024-09-17T16:42:45.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497362+0000", 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1165000000000001e-05 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497371+0000", 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.85e-06 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497442+0000", 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0967e-05 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497451+0000", 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6989999999999992e-06 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012148320000000001 2024-09-17T16:42:45.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509637+0000", 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8031000000000002e-05 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.364083373, 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015236921, 2024-09-17T16:42:45.913 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499063+0000", 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1850000000000001e-06 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499453+0000", 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039015399999999998 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499469+0000", 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6203000000000001e-05 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499478+0000", 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6039999999999993e-06 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499561+0000", 2024-09-17T16:42:45.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3509000000000003e-05 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499570+0000", 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1050000000000001e-06 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514274+0000", 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014703344 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514298+0000", 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4817e-05 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.360158917, 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082760230000000004, 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502987+0000", 2024-09-17T16:42:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.035e-06 2024-09-17T16:42:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503283+0000", 2024-09-17T16:42:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029568200000000002 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503296+0000", 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3321e-05 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503305+0000", 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7620000000000001e-06 2024-09-17T16:42:45.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503370+0000", 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5180999999999998e-05 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503380+0000", 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0489000000000001e-05 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511230+0000", 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078494970000000004 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511262+0000", 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2055999999999999e-05 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 17.357903464, 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090908770000000007, 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505242+0000", 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4099999999999997e-07 2024-09-17T16:42:45.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505687+0000", 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00044460700000000002 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505704+0000", 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7407000000000001e-05 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505714+0000", 2024-09-17T16:42:45.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5829999999999996e-06 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505775+0000", 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1254999999999995e-05 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505785+0000", 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9559999999999992e-06 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514308+0000", 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085228439999999999 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514332+0000", 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4383999999999999e-05 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.370558078999998, 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013544347999999999, 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3200000000000001e-07 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493013+0000", 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00042638399999999998 2024-09-17T16:42:45.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493028+0000", 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4295e-05 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493038+0000", 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0543999999999999e-05 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493139+0000", 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100438 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493149+0000", 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0241000000000001e-05 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506098+0000", 2024-09-17T16:42:45.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012948665 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506131+0000", 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3549e-05 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=106, reqid=client.4553.0:401, at_version=56'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.364397002, 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074167790000000001, 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498749+0000", 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.142e-06 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498887+0000", 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013788200000000001 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498910+0000", 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2765e-05 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498921+0000", 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1112e-05 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.499464+0000", 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054371699999999999 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.499474+0000", 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8980000000000008e-06 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506141+0000", 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066664640000000004 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506165+0000", 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3799e-05 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:45.938 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.360722008, 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063340460000000003, 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502423+0000", 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1699999999999998e-07 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502664+0000", 2024-09-17T16:42:45.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00024058 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502676+0000", 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1916000000000001e-05 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502685+0000", 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6410000000000008e-06 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502759+0000", 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4090000000000004e-05 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.502772+0000", 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2849e-05 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508727+0000", 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059550530000000001 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.508757+0000", 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0300000000000001e-05 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 56/34 ECSubWrite(tid=110, reqid=client.4553.0:406, at_version=56'73, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.509416+0000", 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.353728899, 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0060246579999999996, 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.943 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509416+0000", 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509416+0000", 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509417+0000", 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9599999999999999e-07 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509661+0000", 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00024437200000000002 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509675+0000", 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4397e-05 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509684+0000", 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7409999999999998e-06 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509735+0000", 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0723999999999997e-05 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.509740+0000", 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.626e-06 2024-09-17T16:42:45.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.515420+0000", 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056798609999999996 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.515441+0000", 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0241000000000002e-05 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.411766829999999, 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085986420000000001, 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0499999999999999e-07 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452396+0000", 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00101738 2024-09-17T16:42:45.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452411+0000", 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5406000000000001e-05 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452420+0000", 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.302e-06 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452496+0000", 2024-09-17T16:42:45.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5372999999999998e-05 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452505+0000", 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5750000000000007e-06 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459945+0000", 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074392540000000002 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459977+0000", 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2047e-05 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=62'108, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.404136203, 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088499939999999999, 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.953 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1500000000000004e-07 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459030+0000", 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0313999999999999e-05 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459043+0000", 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3010000000000001e-05 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459050+0000", 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7409999999999992e-06 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459111+0000", 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0671999999999998e-05 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459120+0000", 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467826+0000", 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087057220000000008 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467859+0000", 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2592000000000002e-05 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.40268238, 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010326251, 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460463+0000", 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1600000000000001e-07 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460617+0000", 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000153993 2024-09-17T16:42:45.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460630+0000", 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2549e-05 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460639+0000", 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0669999999999998e-06 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460779+0000", 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000140159 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460843+0000", 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4352999999999999e-05 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470758+0000", 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0099145610000000006 2024-09-17T16:42:45.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470789+0000", 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0953e-05 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 71/34 ECSubWrite(tid=218, reqid=client.4553.0:541, at_version=71'87, trim_to=0'0, roll_forward_to=64'84))", 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.460249+0000", 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.4028954310000001, 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076668889999999996, 2024-09-17T16:42:45.962 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460249+0000", 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460249+0000", 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460250+0000", 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3200000000000004e-07 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460383+0000", 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000132898 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460396+0000", 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2729e-05 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460407+0000", 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1626e-05 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460474+0000", 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6323999999999997e-05 2024-09-17T16:42:45.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460485+0000", 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0822000000000001e-05 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467873+0000", 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.007388459 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467916+0000", 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3299e-05 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.449572+0000", 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.413572891, 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005824966, 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.967 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.449572+0000", 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.449572+0000", 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.449573+0000", 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1009999999999999e-06 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.449930+0000", 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00035724699999999999 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.449950+0000", 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9411000000000001e-05 2024-09-17T16:42:45.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.449959+0000", 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5070000000000006e-06 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.450027+0000", 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7861999999999995e-05 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.450037+0000", 2024-09-17T16:42:45.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6479999999999998e-06 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.455363+0000", 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053262309999999998 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.455397+0000", 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3958999999999998e-05 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.971 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.40516933199999999, 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011234937, 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457976+0000", 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4099999999999998e-07 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458102+0000", 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012563099999999999 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458116+0000", 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3919e-05 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458124+0000", 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8040000000000002e-06 2024-09-17T16:42:45.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458188+0000", 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4793000000000001e-05 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458197+0000", 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9649999999999997e-06 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.469156+0000", 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010959106999999999 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.469210+0000", 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3977000000000002e-05 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:45.976 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.40006155100000002, 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095375779999999997, 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:42:45.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463084+0000", 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5099999999999999e-07 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463284+0000", 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019973899999999999 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463300+0000", 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5948999999999999e-05 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463309+0000", 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6169999999999996e-06 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463477+0000", 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016754000000000001 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463487+0000", 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0301e-05 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.472531+0000", 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090443920000000001 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:45.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.472621+0000", 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9388999999999994e-05 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:45.981 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:45.983 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:45.983 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:45.983 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:45.984 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:45.980+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:46.083 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:46.081+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:46.093 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:46.097 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.097 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.106 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:46.110 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:46.111 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:46.126+0000 7fce3a7fc640 0 -- 172.21.15.60:0/828872959 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fce3c220fd0 msgr2=0x7fce3c2233e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:46.130 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:46.147 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:46.147 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:46.184 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:46.182+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:46.210 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.210 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.218 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:46.285 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:46.283+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:46.361 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.361 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:46.386 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:46.383+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:222: done (4 left) 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:224: done (3 left) 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:225: done (2 left) 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:226: done (1 left) 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:227: done (0 left) 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 30 current snap is 20 2024-09-17T16:42:46.446 INFO:tasks.rados.rados.0.smithi183.stdout:228: seq_num 97 ranges {2080768=475136,2555904=442368,2998272=442368,3440640=278528} 2024-09-17T16:42:46.459 INFO:tasks.rados.rados.0.smithi183.stdout:228: writing smithi18337221-30 from 2080768 to 2555904 tid 1 2024-09-17T16:42:46.461 INFO:tasks.rados.rados.0.smithi183.stdout:228: writing smithi18337221-30 from 2555904 to 2998272 tid 2 2024-09-17T16:42:46.464 INFO:tasks.rados.rados.0.smithi183.stdout:228: writing smithi18337221-30 from 2998272 to 3440640 tid 3 2024-09-17T16:42:46.465 INFO:tasks.rados.rados.0.smithi183.stdout:228: writing smithi18337221-30 from 3440640 to 3719168 tid 4 2024-09-17T16:42:46.465 INFO:tasks.rados.rados.0.smithi183.stdout:229: setattr oid 11 current snap is 20 2024-09-17T16:42:46.467 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 48 current snap is 20 2024-09-17T16:42:46.467 INFO:tasks.rados.rados.0.smithi183.stdout:230: seq_num 98 ranges {802816=491520,1294336=589824,1884160=557056,2441216=16384} 2024-09-17T16:42:46.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:42:46.474 INFO:tasks.rados.rados.0.smithi183.stdout:230: writing smithi18337221-48 from 802816 to 1294336 tid 1 2024-09-17T16:42:46.477 INFO:tasks.rados.rados.0.smithi183.stdout:230: writing smithi18337221-48 from 1294336 to 1884160 tid 2 2024-09-17T16:42:46.479 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.480 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.481 INFO:tasks.rados.rados.0.smithi183.stdout:230: writing smithi18337221-48 from 1884160 to 2441216 tid 3 2024-09-17T16:42:46.481 INFO:tasks.rados.rados.0.smithi183.stdout:230: writing smithi18337221-48 from 2441216 to 2457600 tid 4 2024-09-17T16:42:46.481 INFO:tasks.rados.rados.0.smithi183.stdout:231: snap_create 2024-09-17T16:42:46.481 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 149 (ObjNum 62 snap 6 seq_num 62) dirty exists 2024-09-17T16:42:46.482 INFO:tasks.rados.rados.0.smithi183.stdout:228: finishing write tid 1 to smithi18337221-30 2024-09-17T16:42:46.482 INFO:tasks.rados.rados.0.smithi183.stdout:228: finishing write tid 2 to smithi18337221-30 2024-09-17T16:42:46.482 INFO:tasks.rados.rados.0.smithi183.stdout:228: finishing write tid 3 to smithi18337221-30 2024-09-17T16:42:46.482 INFO:tasks.rados.rados.0.smithi183.stdout:228: finishing write tid 4 to smithi18337221-30 2024-09-17T16:42:46.483 INFO:tasks.rados.rados.0.smithi183.stdout:228: finishing write tid 5 to smithi18337221-30 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:228: finishing write tid 6 to smithi18337221-30 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:228: oid 30 updating version 0 to 94 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:228: oid 30 updating version 94 to 97 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:228: oid 30 version 97 is already newer than 95 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:228: oid 30 version 97 is already newer than 96 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:228: oid 30 version 97 is already newer than 93 2024-09-17T16:42:46.485 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 30 v 97 (ObjNum 97 snap 20 seq_num 97) dirty exists 2024-09-17T16:42:46.486 INFO:tasks.rados.rados.0.smithi183.stdout:228: left oid 30 (ObjNum 97 snap 20 seq_num 97) 2024-09-17T16:42:46.486 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:46.485+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:46.488 INFO:tasks.rados.rados.0.smithi183.stdout:230: finishing write tid 1 to smithi18337221-48 2024-09-17T16:42:46.489 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:46.494 INFO:tasks.rados.rados.0.smithi183.stdout:230: finishing write tid 2 to smithi18337221-48 2024-09-17T16:42:46.494 INFO:tasks.rados.rados.0.smithi183.stdout:230: finishing write tid 3 to smithi18337221-48 2024-09-17T16:42:46.495 INFO:tasks.rados.rados.0.smithi183.stdout:230: finishing write tid 4 to smithi18337221-48 2024-09-17T16:42:46.500 INFO:tasks.rados.rados.0.smithi183.stdout:230: finishing write tid 5 to smithi18337221-48 2024-09-17T16:42:46.502 INFO:tasks.rados.rados.0.smithi183.stdout:230: finishing write tid 6 to smithi18337221-48 2024-09-17T16:42:46.502 INFO:tasks.rados.rados.0.smithi183.stdout:230: oid 48 updating version 0 to 13 2024-09-17T16:42:46.502 INFO:tasks.rados.rados.0.smithi183.stdout:230: oid 48 updating version 13 to 17 2024-09-17T16:42:46.502 INFO:tasks.rados.rados.0.smithi183.stdout:230: oid 48 version 17 is already newer than 15 2024-09-17T16:42:46.503 INFO:tasks.rados.rados.0.smithi183.stdout:230: oid 48 version 17 is already newer than 16 2024-09-17T16:42:46.503 INFO:tasks.rados.rados.0.smithi183.stdout:230: oid 48 version 17 is already newer than 14 2024-09-17T16:42:46.503 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 48 v 17 (ObjNum 98 snap 20 seq_num 98) dirty exists 2024-09-17T16:42:46.503 INFO:tasks.rados.rados.0.smithi183.stdout:230: left oid 48 (ObjNum 98 snap 20 seq_num 98) 2024-09-17T16:42:46.589 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:46.586+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:46.632 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.632 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.641 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:46.688 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:46.686+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:46.784 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.784 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.789 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:46.787+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:46.792 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:46.891 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:46.888+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:46.895 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:46.895 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:46.904 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:46.991 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:46.989+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:47.006 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.006 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.014 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:47.092 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:47.090+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:47.117 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.117 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.125 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:47.193 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:47.191+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:47.228 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.229 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.237 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:47.294 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:47.292+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:47.379 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.379 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.387 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:47.395 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:47.393+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:47.448 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:228: done (3 left) 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:229: done (2 left) 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:230: done (1 left) 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:231: done (0 left) 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:232: read oid 46 snap 19 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:232: expect deleted 2024-09-17T16:42:47.452 INFO:tasks.rados.rados.0.smithi183.stdout:233: delete oid 24 current snap is 21 2024-09-17T16:42:47.457 INFO:tasks.rados.rados.0.smithi183.stdout:232: done (1 left) 2024-09-17T16:42:47.457 INFO:tasks.rados.rados.0.smithi183.stdout:233: done (0 left) 2024-09-17T16:42:47.457 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 38 current snap is 21 2024-09-17T16:42:47.457 INFO:tasks.rados.rados.0.smithi183.stdout:234: seq_num 100 ranges {147456=524288,671744=753664,1425408=409600} 2024-09-17T16:42:47.461 INFO:tasks.rados.rados.0.smithi183.stdout:234: writing smithi18337221-38 from 147456 to 671744 tid 1 2024-09-17T16:42:47.465 INFO:tasks.rados.rados.0.smithi183.stdout:234: writing smithi18337221-38 from 671744 to 1425408 tid 2 2024-09-17T16:42:47.468 INFO:tasks.rados.rados.0.smithi183.stdout:234: writing smithi18337221-38 from 1425408 to 1835008 tid 3 2024-09-17T16:42:47.468 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 11 current snap is 21 2024-09-17T16:42:47.468 INFO:tasks.rados.rados.0.smithi183.stdout:235: seq_num 101 ranges {1638400=540672,2179072=507904,2686976=622592,3309568=32768} 2024-09-17T16:42:47.481 INFO:tasks.rados.rados.0.smithi183.stdout:235: writing smithi18337221-11 from 1638400 to 2179072 tid 1 2024-09-17T16:42:47.483 INFO:tasks.rados.rados.0.smithi183.stdout:235: writing smithi18337221-11 from 2179072 to 2686976 tid 2 2024-09-17T16:42:47.487 INFO:tasks.rados.rados.0.smithi183.stdout:235: writing smithi18337221-11 from 2686976 to 3309568 tid 3 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:235: writing smithi18337221-11 from 3309568 to 3342336 tid 4 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:236: copy_from oid 22 from oid 17 current snap is 21 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: finishing write tid 1 to smithi18337221-38 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: finishing write tid 2 to smithi18337221-38 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: finishing write tid 3 to smithi18337221-38 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: finishing write tid 4 to smithi18337221-38 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: finishing write tid 5 to smithi18337221-38 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: oid 38 updating version 0 to 32 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: oid 38 updating version 32 to 33 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: oid 38 version 33 is already newer than 31 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: oid 38 updating version 33 to 34 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 38 v 34 (ObjNum 100 snap 21 seq_num 100) dirty exists 2024-09-17T16:42:47.488 INFO:tasks.rados.rados.0.smithi183.stdout:234: left oid 38 (ObjNum 100 snap 21 seq_num 100) 2024-09-17T16:42:47.489 INFO:tasks.rados.rados.0.smithi183.stdout:234: done (2 left) 2024-09-17T16:42:47.489 INFO:tasks.rados.rados.0.smithi183.stdout:237: snap_create 2024-09-17T16:42:47.495 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:47.493+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:47.496 INFO:tasks.rados.rados.0.smithi183.stdout:235: finishing write tid 1 to smithi18337221-11 2024-09-17T16:42:47.497 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.497 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.498 INFO:tasks.rados.rados.0.smithi183.stdout:236: finishing copy_from racing read to smithi18337221-22 2024-09-17T16:42:47.499 INFO:tasks.rados.rados.0.smithi183.stdout:236: finishing copy_from to smithi18337221-22 2024-09-17T16:42:47.499 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 22 v 26 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-09-17T16:42:47.503 INFO:tasks.rados.rados.0.smithi183.stdout:235: finishing write tid 2 to smithi18337221-11 2024-09-17T16:42:47.505 INFO:tasks.rados.rados.0.smithi183.stdout:235: finishing write tid 3 to smithi18337221-11 2024-09-17T16:42:47.505 INFO:tasks.rados.rados.0.smithi183.stdout:235: finishing write tid 4 to smithi18337221-11 2024-09-17T16:42:47.508 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:47.509 INFO:tasks.rados.rados.0.smithi183.stdout:235: finishing write tid 5 to smithi18337221-11 2024-09-17T16:42:47.510 INFO:tasks.rados.rados.0.smithi183.stdout:235: finishing write tid 6 to smithi18337221-11 2024-09-17T16:42:47.510 INFO:tasks.rados.rados.0.smithi183.stdout:235: oid 11 updating version 0 to 155 2024-09-17T16:42:47.511 INFO:tasks.rados.rados.0.smithi183.stdout:235: oid 11 version 155 is already newer than 153 2024-09-17T16:42:47.511 INFO:tasks.rados.rados.0.smithi183.stdout:235: oid 11 version 155 is already newer than 151 2024-09-17T16:42:47.511 INFO:tasks.rados.rados.0.smithi183.stdout:235: oid 11 version 155 is already newer than 154 2024-09-17T16:42:47.511 INFO:tasks.rados.rados.0.smithi183.stdout:235: oid 11 version 155 is already newer than 152 2024-09-17T16:42:47.511 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 155 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-09-17T16:42:47.511 INFO:tasks.rados.rados.0.smithi183.stdout:235: left oid 11 (ObjNum 101 snap 21 seq_num 101) 2024-09-17T16:42:47.596 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:47.594+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:47.616 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.616 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:47.697 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:47.695+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:47.767 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.768 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.776 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:47.820 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:47.818+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:47.878 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:47.878 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:47.886 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:47.927 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:47.925+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:48.001 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:47.999+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:48.029 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:48.030 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:48.038 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:48.101 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:48.099+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:48.140 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:48.140 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:48.148 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:48.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:48.233 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:48.231+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:48.293 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:48.293 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:48.298 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:48.298 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:48.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:48.316 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:48.317 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:48.333 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:48.333 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:48.343 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:48.341+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:48.351 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:48.367 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:48.367 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:48.384 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:48.384 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:48.404 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:48.402+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:48.445 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:48.445 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:48.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:235: done (2 left) 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:236: done (1 left) 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:237: done (0 left) 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:238: read oid 23 snap -1 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:238: expect (ObjNum 93 snap 18 seq_num 93) 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:239: read oid 43 snap -1 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:239: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:42:48.456 INFO:tasks.rados.rados.0.smithi183.stdout:240: snap_create 2024-09-17T16:42:48.463 INFO:tasks.rados.rados.0.smithi183.stdout:238: expect (ObjNum 93 snap 18 seq_num 93) 2024-09-17T16:42:48.473 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1851074 2024-09-17T16:42:48.474 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:48.503 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1777224 2024-09-17T16:42:48.505 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:48.503+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:48.506 INFO:tasks.rados.rados.0.smithi183.stdout:239: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:42:48.506 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:48.509 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:48.512 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 66758 2024-09-17T16:42:48.559 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:48.559 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:48.568 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:48.602 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:48.602 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:48.605 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:48.603+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:48.619 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:48.619 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:48.636 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:48.652 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:48.653 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:48.669 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:48.672 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.158321208, 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013863510000000001, 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.673 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513354+0000", 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001750883 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513367+0000", 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3108999999999999e-05 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513376+0000", 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8969999999999997e-06 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513451+0000", 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513461+0000", 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0023999999999999e-05 2024-09-17T16:42:48.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525431+0000", 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011969377 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525467+0000", 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5988000000000002e-05 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.149973325000001, 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083605350000000005, 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519951+0000", 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.519952+0000", 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9800000000000002e-07 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520423+0000", 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00047090499999999998 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520443+0000", 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0477000000000001e-05 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520453+0000", 2024-09-17T16:42:48.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5440000000000004e-06 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520913+0000", 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045979899999999999 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520921+0000", 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3010000000000007e-06 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528270+0000", 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073484370000000002 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2073999999999997e-05 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:48.682 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.147254557, 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089774009999999994, 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999999e-07 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523392+0000", 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072203800000000004 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523434+0000", 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1365000000000001e-05 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523451+0000", 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7119e-05 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523565+0000", 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011433 2024-09-17T16:42:48.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523577+0000", 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1697e-05 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531599+0000", 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080225629999999999 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531647+0000", 2024-09-17T16:42:48.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7960000000000002e-05 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=93, reqid=osd.5.0:93, at_version=55'60, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.184923993999998, 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099079770000000001, 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.687 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485001+0000", 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485013+0000", 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2393e-05 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485021+0000", 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9230000000000002e-06 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485026+0000", 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0980000000000001e-06 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485078+0000", 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1650999999999997e-05 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485087+0000", 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9039999999999998e-06 2024-09-17T16:42:48.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494869+0000", 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097825159999999998 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494908+0000", 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.909e-05 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 55/34 ECSubWrite(tid=60, reqid=osd.14.0:60, at_version=55'29, trim_to=0'0, roll_forward_to=53'25))", 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.184447896000002, 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091203440000000007, 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:48.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485497+0000", 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0041e-05 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485509+0000", 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1668000000000001e-05 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485517+0000", 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.841e-06 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485572+0000", 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325999999999998e-05 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485582+0000", 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105000000000001e-05 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494561+0000", 2024-09-17T16:42:48.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089786810000000005 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494597+0000", 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6019000000000002e-05 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.183347814000001, 2024-09-17T16:42:48.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018742894999999999, 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:48.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486599+0000", 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1361000000000001e-05 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486608+0000", 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486616+0000", 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.537e-06 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486743+0000", 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127188 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486748+0000", 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4489999999999998e-06 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505277+0000", 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018528340000000001 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505320+0000", 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2834999999999999e-05 2024-09-17T16:42:48.700 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=122, reqid=osd.4.0:119, at_version=0'0, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.182839282, 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013009134, 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487086+0000", 2024-09-17T16:42:48.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5099999999999999e-07 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487097+0000", 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487113+0000", 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5336e-05 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487121+0000", 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487184+0000", 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3207999999999995e-05 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487195+0000", 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1467999999999999e-05 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499908+0000", 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012713089 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500094+0000", 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000185847 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 55/34 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=55'24, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.180014154999999, 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010075503, 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1899999999999999e-07 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489931+0000", 2024-09-17T16:42:48.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-05 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489946+0000", 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5729000000000001e-05 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489954+0000", 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2549999999999997e-06 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490014+0000", 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9242e-05 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490024+0000", 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.004e-05 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499913+0000", 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098893910000000008 2024-09-17T16:42:48.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499986+0000", 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2607000000000005e-05 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.176571334999998, 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090505629999999993, 2024-09-17T16:42:48.710 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493354+0000", 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7199999999999997e-07 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493765+0000", 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041148500000000001 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493776+0000", 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1021e-05 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493784+0000", 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5569999999999998e-06 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5838999999999999e-05 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493836+0000", 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.993e-06 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502370+0000", 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085342400000000002 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502404+0000", 2024-09-17T16:42:48.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3556000000000002e-05 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.171041122999998, 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011728341, 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.715 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498884+0000", 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6400000000000001e-07 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499236+0000", 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035160500000000001 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499249+0000", 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3454e-05 2024-09-17T16:42:48.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499256+0000", 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.905e-06 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499318+0000", 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2067000000000001e-05 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499329+0000", 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1131000000000001e-05 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510579+0000", 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011250135 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510612+0000", 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2280000000000003e-05 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.719 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.063027224999999, 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089676530000000008, 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606898+0000", 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9699999999999995e-07 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607272+0000", 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037431900000000002 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607286+0000", 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.328e-05 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607294+0000", 2024-09-17T16:42:48.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8179999999999993e-06 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607356+0000", 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1290000000000004e-05 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607366+0000", 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8949999999999993e-06 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.615839+0000", 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084733959999999994 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.615865+0000", 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5857999999999999e-05 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:48.724 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.151352166000001, 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011339162, 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.725 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518573+0000", 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518909+0000", 2024-09-17T16:42:48.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033576100000000001 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518925+0000", 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5661000000000001e-05 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518933+0000", 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4209999999999995e-06 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519013+0000", 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0346000000000006e-05 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519023+0000", 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0212e-05 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529853+0000", 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010829221 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529911+0000", 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8709999999999999e-05 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.218705064, 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016876885000000001, 2024-09-17T16:42:48.729 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451220+0000", 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7499999999999999e-07 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451677+0000", 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045773500000000002 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451691+0000", 2024-09-17T16:42:48.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3679000000000001e-05 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451699+0000", 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0679999999999997e-06 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451773+0000", 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4064000000000001e-05 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451783+0000", 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9259999999999995e-06 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468036+0000", 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016253360000000001 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468096+0000", 2024-09-17T16:42:48.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9877999999999998e-05 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 62/34 ECSubWrite(tid=178, reqid=osd.4.0:178, at_version=62'26, trim_to=0'0, roll_forward_to=61'24))", 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.215512597, 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092270379999999999, 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.734 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-07 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454436+0000", 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3799999999999999e-05 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454444+0000", 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3459999999999994e-06 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454449+0000", 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0939999999999998e-06 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454497+0000", 2024-09-17T16:42:48.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7525000000000003e-05 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454502+0000", 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4299999999999997e-06 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463615+0000", 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091123920000000004 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463639+0000", 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4141000000000001e-05 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 62/34 ECSubWrite(tid=177, reqid=osd.4.0:177, at_version=62'41, trim_to=0'0, roll_forward_to=61'39))", 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.215397633, 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090665380000000007, 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.739 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7e-07 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454543+0000", 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5809999999999999e-05 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454551+0000", 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7559999999999999e-06 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454557+0000", 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4609999999999996e-06 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454604+0000", 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6408e-05 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454611+0000", 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4379999999999998e-06 2024-09-17T16:42:48.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463555+0000", 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089443869999999998 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463593+0000", 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7907999999999997e-05 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 62/34 ECSubWrite(tid=179, reqid=osd.4.0:179, at_version=62'43, trim_to=0'0, roll_forward_to=61'39))", 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.455721+0000", 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.21420318, 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088753960000000007, 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455721+0000", 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455721+0000", 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455722+0000", 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455741+0000", 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9023999999999999e-05 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455753+0000", 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1765e-05 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455761+0000", 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2609999999999993e-06 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455817+0000", 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.605e-05 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455825+0000", 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3990000000000004e-06 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464562+0000", 2024-09-17T16:42:48.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087364279999999992 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464597+0000", 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4739000000000001e-05 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=161, reqid=osd.5.0:161, at_version=62'106, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:48.748 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.212415728, 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010613879999999999, 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.749 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.37e-07 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457532+0000", 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2344000000000002e-05 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457542+0000", 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0698e-05 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457550+0000", 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9289999999999998e-06 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458149+0000", 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059811399999999996 2024-09-17T16:42:48.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458387+0000", 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238247 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468103+0000", 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097161869999999994 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468123+0000", 2024-09-17T16:42:48.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9624e-05 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=62'108, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.210939544, 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091647150000000004, 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.753 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458986+0000", 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7800000000000001e-07 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459007+0000", 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1586999999999998e-05 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459017+0000", 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0142999999999999e-05 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459026+0000", 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8200000000000003e-06 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459585+0000", 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055877100000000001 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459593+0000", 2024-09-17T16:42:48.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1519999999999992e-06 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468128+0000", 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085349339999999992 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468150+0000", 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1630000000000001e-05 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.757 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.209614333999999, 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094236489999999992, 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:42:48.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460311+0000", 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5899999999999996e-07 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460665+0000", 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035421500000000001 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460681+0000", 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5739e-05 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460689+0000", 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3340000000000002e-06 2024-09-17T16:42:48.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464005+0000", 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033161390000000001 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464015+0000", 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0242e-05 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469702+0000", 2024-09-17T16:42:48.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056865780000000003 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469734+0000", 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1843e-05 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:42:48.762 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.215630974, 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013750108, 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:48.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454294+0000", 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6e-07 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081548199999999997 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455123+0000", 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4392999999999999e-05 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455130+0000", 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6800000000000004e-06 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455201+0000", 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1088999999999996e-05 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455214+0000", 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2923e-05 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.467980+0000", 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012766136000000001 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:48.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.468044+0000", 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3244999999999995e-05 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:48.767 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:48.768 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:48.769 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:48.769 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:48.770 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:48.770 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:48.770 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:48.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:48.736+0000 7f7baaffd640 0 -- 172.21.15.60:0/326189157 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7f7bac21eb30 msgr2=0x7f7bac220f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:48.771 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:48.771 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:48.772 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:48.773 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:48.767+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:48.869 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:48.868+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:48.875 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:48.875 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:48.875 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:48.885 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:48.970 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:48.968+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:48.987 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:48.987 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:48.987 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:48.987 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:48.987 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:48.995 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:49.071 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:49.069+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:49.097 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:194 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477712+0000", 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.617275863000003, 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010934931, 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.098 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 194 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477712+0000", 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477712+0000", 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477714+0000", 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.978e-06 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477723+0000", 2024-09-17T16:42:49.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477740+0000", 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7058000000000002e-05 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477752+0000", 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1354e-05 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477853+0000", 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000101547 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9889999999999998e-06 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480225+0000", 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023626950000000002 2024-09-17T16:42:49.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480299+0000", 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4194000000000001e-05 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.488647+0000", 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083482360000000002 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:195 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.61721146, 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01148677, 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 195 2024-09-17T16:42:49.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477782+0000", 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0939999999999998e-06 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.106 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477789+0000", 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477795+0000", 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5849999999999999e-06 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000159579 2024-09-17T16:42:49.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477958+0000", 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9879999999999998e-06 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480631+0000", 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026728429999999998 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480694+0000", 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2594000000000004e-05 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.489263+0000", 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085697580000000002 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:196 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:49.109 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.617153608000002, 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011896488, 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 196 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477838+0000", 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9239999999999999e-06 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477844+0000", 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.891e-06 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477850+0000", 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4189999999999999e-06 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000145926 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.478002+0000", 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2090000000000002e-06 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480989+0000", 2024-09-17T16:42:49.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002986542 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481054+0000", 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5227000000000004e-05 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.489731+0000", 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086769480000000003 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.115 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s4 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.604456560000003, 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013315062000000001, 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490758+0000", 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022558800000000001 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490774+0000", 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6350000000000001e-05 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490784+0000", 2024-09-17T16:42:49.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5750000000000007e-06 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490854+0000", 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0339000000000005e-05 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490864+0000", 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6660000000000003e-06 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503808+0000", 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012944073 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503847+0000", 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8612999999999998e-05 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:218 3.0s0 3:0cb75d13:::smithi18337221-6:head [rollback 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:49.120 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.598524365999999, 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011138148, 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 218 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496464+0000", 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9500000000000002e-07 2024-09-17T16:42:49.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496468+0000", 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3589999999999999e-06 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496475+0000", 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4220000000000003e-06 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496484+0000", 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8920000000000006e-06 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497856+0000", 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013717 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.497951+0000", 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5154000000000004e-05 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.498460+0000", 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000509433 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503871+0000", 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0054104929999999997 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507525+0000", 2024-09-17T16:42:49.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003654629 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507602+0000", 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6470999999999993e-05 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:219 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:49.126 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.598495173000003, 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011259471, 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 219 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496493+0000", 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7500000000000001e-07 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496496+0000", 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.745e-06 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496502+0000", 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.964e-06 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.496507+0000", 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8300000000000003e-06 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499175+0000", 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026681489999999999 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499273+0000", 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8039000000000001e-05 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.499803+0000", 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00053041999999999998 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503913+0000", 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0041092480000000002 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507695+0000", 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003782498 2024-09-17T16:42:49.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.507752+0000", 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:251 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~622592] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:42:49.132 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.589885702, 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013520938, 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 251 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:42:49.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505104+0000", 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8870000000000001e-06 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506163+0000", 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010585 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506177+0000", 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4022999999999999e-05 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506185+0000", 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7209999999999994e-06 2024-09-17T16:42:49.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506254+0000", 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9264000000000006e-05 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506349+0000", 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4704999999999995e-05 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507791+0000", 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014424469999999999 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517101+0000", 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093103430000000004 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518539+0000", 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00143816 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518623+0000", 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3887999999999994e-05 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:252 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~376832] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.587832948999999, 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014876686, 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 252 2024-09-17T16:42:49.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507156+0000", 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2309999999999999e-06 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507825+0000", 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066852899999999995 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507839+0000", 2024-09-17T16:42:49.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4260999999999999e-05 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507848+0000", 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9660000000000002e-06 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513602+0000", 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057539069999999999 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513711+0000", 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010927199999999999 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.514507+0000", 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079574400000000003 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518107+0000", 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035998129999999999 2024-09-17T16:42:49.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.521980+0000", 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038731780000000001 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522032+0000", 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1785e-05 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:253 3.9s0 3:97a3b59a:::smithi18337221-19:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.587116282, 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01439824, 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.145 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 253 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507873+0000", 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1319999999999999e-06 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507897+0000", 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.44e-05 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507905+0000", 2024-09-17T16:42:49.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9980000000000003e-06 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507913+0000", 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2849999999999997e-06 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517178+0000", 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092654350000000007 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517280+0000", 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102011 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517762+0000", 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048150100000000001 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518681+0000", 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091987099999999995 2024-09-17T16:42:49.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522146+0000", 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003464895 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522270+0000", 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123712 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:254 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.587063638, 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014640482, 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 254 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.151 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507925+0000", 2024-09-17T16:42:49.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4700000000000001e-07 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507927+0000", 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0789999999999999e-06 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507932+0000", 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8400000000000002e-06 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507935+0000", 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3380000000000001e-06 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518013+0000", 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077697 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518096+0000", 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2707000000000006e-05 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522552+0000", 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044558430000000001 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522565+0000", 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3431000000000001e-05 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as4 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.583293491999999, 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011705553, 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3700000000000001e-07 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512098+0000", 2024-09-17T16:42:49.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040260399999999998 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4521999999999999e-05 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512121+0000", 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.969e-06 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512181+0000", 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9756000000000002e-05 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512191+0000", 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0351e-05 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523363+0000", 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011172059 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523400+0000", 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6854999999999999e-05 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:305 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.644001349, 2024-09-17T16:42:49.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010016393, 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 305 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:49.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450987+0000", 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3799999999999998e-07 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450990+0000", 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.531e-06 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450994+0000", 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3869999999999997e-06 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.450998+0000", 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.907e-06 2024-09-17T16:42:49.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451169+0000", 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000171282 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451178+0000", 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5590000000000006e-06 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.457382+0000", 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062037280000000004 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.457501+0000", 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000119138 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461003+0000", 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003502523 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.165 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:306 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.643985463, 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011720622999999999, 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.166 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 306 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451005+0000", 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8729999999999999e-06 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451008+0000", 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5949999999999999e-06 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451011+0000", 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.072e-06 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451218+0000", 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020686399999999999 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451222+0000", 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.444e-06 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461055+0000", 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.009833385 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461120+0000", 2024-09-17T16:42:49.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5279999999999998e-05 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.462723+0000", 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016028679999999999 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:307 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:42:49.171 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.643972777999998, 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012102027, 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 307 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451016+0000", 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3999999999999998e-07 2024-09-17T16:42:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451017+0000", 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6309999999999999e-06 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451021+0000", 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4170000000000001e-06 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451024+0000", 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9019999999999999e-06 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451255+0000", 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023170600000000001 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451262+0000", 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4470000000000003e-06 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461381+0000", 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010119067000000001 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461453+0000", 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2119999999999994e-05 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.463117+0000", 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001664497 2024-09-17T16:42:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:348 3.0s0 3:09c9e185:::smithi18337221-48:head [read 0~802816,checksum,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.480865+0000", 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.614122860999998, 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097959680000000004, 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 348 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480865+0000", 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480865+0000", 2024-09-17T16:42:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480866+0000", 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1179999999999999e-06 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480871+0000", 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6639999999999997e-06 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480887+0000", 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6195e-05 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480895+0000", 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8699999999999992e-06 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480958+0000", 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2988000000000001e-05 2024-09-17T16:42:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480965+0000", 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1199999999999996e-06 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.483321+0000", 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023560539999999998 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.483412+0000", 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0985999999999999e-05 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490661+0000", 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072489729999999997 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:349 3.0s0 3:09c9e185:::smithi18337221-48:head [read 0~802816,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.480913+0000", 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.614075319000001, 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010264077, 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 349 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480913+0000", 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480913+0000", 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480913+0000", 2024-09-17T16:42:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6599999999999996e-07 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480917+0000", 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2739999999999999e-06 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480924+0000", 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0979999999999996e-06 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480930+0000", 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.818e-06 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.481001+0000", 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1182999999999999e-05 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.481006+0000", 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5230000000000003e-06 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.483881+0000", 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0028742249999999998 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.483967+0000", 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6059999999999999e-05 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.491177+0000", 2024-09-17T16:42:49.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072102299999999998 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:350 3.0s0 3:09c9e185:::smithi18337221-48:head [read 41550~761266,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.480945+0000", 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.614043213999999, 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010586659999999999, 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:49.188 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 350 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480945+0000", 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480945+0000", 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480945+0000", 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0500000000000004e-07 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480948+0000", 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5450000000000002e-06 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480954+0000", 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3010000000000003e-06 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480960+0000", 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2179999999999996e-06 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.481033+0000", 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2597999999999998e-05 2024-09-17T16:42:49.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.481038+0000", 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3619999999999997e-06 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484263+0000", 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032247059999999999 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:49.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.484346+0000", 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2812999999999995e-05 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.491532+0000", 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0071856120000000001 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.4s5 55/34 ECSubWrite(tid=33, reqid=osd.8.0:33, at_version=55'22, trim_to=0'0, roll_forward_to=53'20))", 2024-09-17T16:42:49.193 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.486803+0000", 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.608184965, 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010482567, 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486803+0000", 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486803+0000", 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486804+0000", 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3399999999999999e-07 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486823+0000", 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8776000000000001e-05 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486835+0000", 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2918000000000001e-05 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486843+0000", 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3270000000000003e-06 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486905+0000", 2024-09-17T16:42:49.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2317999999999995e-05 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486911+0000", 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.631e-06 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.497250+0000", 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010339474 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.497286+0000", 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5488999999999999e-05 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.4s5 62/34 ECSubWrite(tid=48, reqid=osd.8.0:48, at_version=62'40, trim_to=0'0, roll_forward_to=61'36))", 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.449611+0000", 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 13.645377193, 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011058348000000001, 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.198 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.449611+0000", 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.449611+0000", 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.449612+0000", 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.61e-07 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.449629+0000", 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7652e-05 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.449640+0000", 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1239e-05 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.449649+0000", 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2900000000000002e-06 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.450144+0000", 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00049477600000000005 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.450149+0000", 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4750000000000001e-06 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460634+0000", 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010485110000000001 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460669+0000", 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5145000000000003e-05 2024-09-17T16:42:49.202 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as4 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.640677646, 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016135330999999999, 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:49.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:49.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454311+0000", 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454926+0000", 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061552000000000004 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454943+0000", 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6433999999999999e-05 2024-09-17T16:42:49.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454970+0000", 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7345999999999999e-05 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455041+0000", 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1317999999999997e-05 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455050+0000", 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4160000000000004e-06 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470410+0000", 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015359937000000001 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470446+0000", 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6010999999999998e-05 2024-09-17T16:42:49.207 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.208 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:49.208 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:49.208 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:49.210 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:49.210 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:49.207+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:49.310 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:49.308+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:49.326 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:49.326 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:49.326 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:49.335 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:49.411 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:49.409+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:49.467 INFO:tasks.rados.rados.0.smithi183.stdout:238: done (2 left) 2024-09-17T16:42:49.467 INFO:tasks.rados.rados.0.smithi183.stdout:239: done (1 left) 2024-09-17T16:42:49.467 INFO:tasks.rados.rados.0.smithi183.stdout:240: done (0 left) 2024-09-17T16:42:49.468 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 35 current snap is 23 2024-09-17T16:42:49.468 INFO:tasks.rados.rados.0.smithi183.stdout:241: seq_num 102 ranges {442368=557056,999424=638976,1638400=524288} 2024-09-17T16:42:49.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:42:49.472 INFO:tasks.rados.rados.0.smithi183.stdout:241: writing smithi18337221-35 from 442368 to 999424 tid 1 2024-09-17T16:42:49.475 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:49.475 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:49.475 INFO:tasks.thrashosds.thrasher:Removing osd 13, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] 2024-09-17T16:42:49.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 13 2024-09-17T16:42:49.476 INFO:tasks.rados.rados.0.smithi183.stdout:241: writing smithi18337221-35 from 999424 to 1638400 tid 2 2024-09-17T16:42:49.480 INFO:tasks.rados.rados.0.smithi183.stdout:241: writing smithi18337221-35 from 1638400 to 2162688 tid 3 2024-09-17T16:42:49.480 INFO:tasks.rados.rados.0.smithi183.stdout:242: setattr oid 19 current snap is 23 2024-09-17T16:42:49.482 INFO:tasks.rados.rados.0.smithi183.stdout:243: rollback oid 49 current snap is 23 2024-09-17T16:42:49.484 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 49 to 21 2024-09-17T16:42:49.484 INFO:tasks.rados.rados.0.smithi183.stdout:244: snap_create 2024-09-17T16:42:49.485 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:49.485 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:49.485 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:49.487 INFO:tasks.rados.rados.0.smithi183.stdout:243: finishing rollback tid 0 to smithi18337221-49 2024-09-17T16:42:49.487 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 19 v 49 (ObjNum 161 snap 0 seq_num 470271744) dirty exists 2024-09-17T16:42:49.488 INFO:tasks.rados.rados.0.smithi183.stdout:243: finishing rollback tid 1 to smithi18337221-49 2024-09-17T16:42:49.489 INFO:tasks.rados.rados.0.smithi183.stdout:243: finishing rollback tid 2 to smithi18337221-49 2024-09-17T16:42:49.489 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 49 v 44 (ObjNum 79 snap 12 seq_num 79) dirty exists 2024-09-17T16:42:49.494 INFO:tasks.rados.rados.0.smithi183.stdout:241: finishing write tid 1 to smithi18337221-35 2024-09-17T16:42:49.494 INFO:tasks.rados.rados.0.smithi183.stdout:241: finishing write tid 2 to smithi18337221-35 2024-09-17T16:42:49.495 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:49.496 INFO:tasks.rados.rados.0.smithi183.stdout:241: finishing write tid 3 to smithi18337221-35 2024-09-17T16:42:49.496 INFO:tasks.rados.rados.0.smithi183.stdout:241: finishing write tid 4 to smithi18337221-35 2024-09-17T16:42:49.498 INFO:tasks.rados.rados.0.smithi183.stdout:241: finishing write tid 5 to smithi18337221-35 2024-09-17T16:42:49.498 INFO:tasks.rados.rados.0.smithi183.stdout:241: oid 35 updating version 0 to 59 2024-09-17T16:42:49.498 INFO:tasks.rados.rados.0.smithi183.stdout:241: oid 35 updating version 59 to 60 2024-09-17T16:42:49.498 INFO:tasks.rados.rados.0.smithi183.stdout:241: oid 35 version 60 is already newer than 58 2024-09-17T16:42:49.498 INFO:tasks.rados.rados.0.smithi183.stdout:241: oid 35 version 60 is already newer than 57 2024-09-17T16:42:49.498 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 35 v 60 (ObjNum 102 snap 23 seq_num 102) dirty exists 2024-09-17T16:42:49.499 INFO:tasks.rados.rados.0.smithi183.stdout:241: left oid 35 (ObjNum 102 snap 23 seq_num 102) 2024-09-17T16:42:49.512 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:49.510+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:49.599 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:49.599 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:49.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:49.599 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:49.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.599 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=47, reqid=client.4553.0:189, at_version=40'19, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.114451183, 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053197139999999997, 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481308+0000", 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5600000000000005e-07 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481341+0000", 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2285e-05 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481355+0000", 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3946e-05 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481407+0000", 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1860999999999997e-05 2024-09-17T16:42:49.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481521+0000", 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000114799 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481534+0000", 2024-09-17T16:42:49.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2384e-05 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486594+0000", 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050600350000000001 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486627+0000", 2024-09-17T16:42:49.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3748000000000003e-05 2024-09-17T16:42:49.607 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.607 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.607 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.608 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:49.608 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:49.608 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.113320864000002, 2024-09-17T16:42:49.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074612999999999997, 2024-09-17T16:42:49.608 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482439+0000", 2024-09-17T16:42:49.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7199999999999998e-07 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482462+0000", 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2668e-05 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482473+0000", 2024-09-17T16:42:49.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482481+0000", 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6130000000000004e-06 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486671+0000", 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041899479999999998 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486680+0000", 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8869999999999998e-06 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489834+0000", 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031540069999999999 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489899+0000", 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5050999999999998e-05 2024-09-17T16:42:49.614 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:42:49.615 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.112610828000001, 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008086981, 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:42:49.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:42:49.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483149+0000", 2024-09-17T16:42:49.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:42:49.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483164+0000", 2024-09-17T16:42:49.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.523e-05 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483175+0000", 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0876999999999999e-05 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483181+0000", 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3029999999999996e-06 2024-09-17T16:42:49.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488038+0000", 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048566149999999999 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488047+0000", 2024-09-17T16:42:49.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3070000000000008e-06 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491189+0000", 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031416790000000001 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491235+0000", 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6241e-05 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 40/34 ECSubWrite(tid=22, reqid=osd.8.0:22, at_version=40'13, trim_to=0'0, roll_forward_to=39'11))", 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.484942+0000", 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.110816729, 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063649750000000001, 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484942+0000", 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484942+0000", 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484943+0000", 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.484964+0000", 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0990999999999999e-05 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.485002+0000", 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7492e-05 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.485011+0000", 2024-09-17T16:42:49.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4469999999999995e-06 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488245+0000", 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336940000000001 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488252+0000", 2024-09-17T16:42:49.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1330000000000001e-06 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491269+0000", 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030173600000000002 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491307+0000", 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7988000000000003e-05 2024-09-17T16:42:49.629 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.103172117, 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013185944, 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492588+0000", 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7600000000000006e-07 2024-09-17T16:42:49.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493009+0000", 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042131299999999998 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493025+0000", 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5605000000000001e-05 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493033+0000", 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.32e-06 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1038000000000006e-05 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493124+0000", 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4909999999999994e-06 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505727+0000", 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012603346 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505773+0000", 2024-09-17T16:42:49.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5855000000000001e-05 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.097223155000002, 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071885259999999998, 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.635 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498537+0000", 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498559+0000", 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2444000000000001e-05 2024-09-17T16:42:49.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498576+0000", 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7067000000000001e-05 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0920000000000004e-06 2024-09-17T16:42:49.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498675+0000", 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9314999999999994e-05 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498682+0000", 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8699999999999992e-06 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505669+0000", 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069863959999999998 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505724+0000", 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5414999999999997e-05 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=26, reqid=client.4553.0:219, at_version=40'9, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499776+0000", 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.095983048999997, 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059763180000000004, 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.641 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499776+0000", 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499776+0000", 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499777+0000", 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.091e-06 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499799+0000", 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1861999999999998e-05 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499819+0000", 2024-09-17T16:42:49.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9743000000000001e-05 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499829+0000", 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0394000000000001e-05 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499895+0000", 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5639e-05 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499904+0000", 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4900000000000006e-06 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505730+0000", 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005825551 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505752+0000", 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2548000000000002e-05 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.645 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 55/34 ECSubWrite(tid=117, reqid=osd.4.0:117, at_version=55'17, trim_to=0'0, roll_forward_to=53'15))", 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.117874243999999, 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056310680000000004, 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477885+0000", 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1300000000000001e-07 2024-09-17T16:42:49.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477915+0000", 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0057999999999999e-05 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477931+0000", 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5760000000000002e-05 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.477943+0000", 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2612999999999999e-05 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.478042+0000", 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8463999999999998e-05 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.478055+0000", 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3062e-05 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.483451+0000", 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053963489999999999 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.483516+0000", 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4648999999999997e-05 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.650 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.498768+0000", 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.096990760000001, 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00632702, 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.498768+0000", 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.498768+0000", 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.498769+0000", 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.11e-06 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499177+0000", 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00040757800000000002 2024-09-17T16:42:49.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499189+0000", 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2265e-05 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499195+0000", 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3389999999999998e-06 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499257+0000", 2024-09-17T16:42:49.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1458999999999996e-05 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.499269+0000", 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1734e-05 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505064+0000", 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0057956509999999998 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505095+0000", 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0883999999999998e-05 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.090957215, 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083741470000000002, 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.655 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504803+0000", 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9100000000000002e-07 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505695+0000", 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089272400000000001 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505712+0000", 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6320999999999998e-05 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505720+0000", 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6780000000000006e-06 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505787+0000", 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6303000000000005e-05 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505797+0000", 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0455000000000001e-05 2024-09-17T16:42:49.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513105+0000", 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007307717 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513176+0000", 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1057999999999996e-05 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.077370576, 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016246389999999999, 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518389+0000", 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.51e-07 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518980+0000", 2024-09-17T16:42:49.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059100999999999999 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519003+0000", 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2819999999999998e-05 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519012+0000", 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519183+0000", 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017095399999999999 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519194+0000", 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.102e-05 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534599+0000", 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015404927000000001 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534635+0000", 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5364000000000002e-05 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.069635206000001, 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085642229999999993, 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.664 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526125+0000", 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999999e-07 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526311+0000", 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018657999999999999 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526341+0000", 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9788999999999999e-05 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526352+0000", 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1379999999999999e-05 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527177+0000", 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082429900000000002 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527187+0000", 2024-09-17T16:42:49.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.06e-05 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534665+0000", 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074776570000000004 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534688+0000", 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2994999999999999e-05 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.668 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=151, reqid=client.4553.0:435, at_version=60'21, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.530141+0000", 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.065618222000001, 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006299313, 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530141+0000", 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530141+0000", 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530142+0000", 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.052e-06 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530304+0000", 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000162666 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530322+0000", 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7193999999999998e-05 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530331+0000", 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7480000000000005e-06 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532020+0000", 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0016885629999999999 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532031+0000", 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0665e-05 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.536399+0000", 2024-09-17T16:42:49.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0043683059999999998 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.536440+0000", 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1118999999999997e-05 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=152, reqid=client.4553.0:436, at_version=60'22, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.532682+0000", 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.063076645999999, 2024-09-17T16:42:49.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0061616350000000004, 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532682+0000", 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532682+0000", 2024-09-17T16:42:49.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532683+0000", 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9900000000000009e-07 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532705+0000", 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1376e-05 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532724+0000", 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9562999999999999e-05 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532734+0000", 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0045e-05 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534724+0000", 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0019899929999999998 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534731+0000", 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4049999999999997e-06 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.538801+0000", 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0040706120000000004 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.538844+0000", 2024-09-17T16:42:49.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2642000000000003e-05 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=147, reqid=osd.5.0:147, at_version=61'93, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.509316+0000", 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.086442494, 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063603189999999997, 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509316+0000", 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509316+0000", 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509317+0000", 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.22e-07 2024-09-17T16:42:49.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509343+0000", 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5982e-05 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509357+0000", 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4015999999999999e-05 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.680 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509366+0000", 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1449999999999997e-06 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509431+0000", 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5228000000000006e-05 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509444+0000", 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2697999999999999e-05 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515637+0000", 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006193077 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515677+0000", 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9950999999999997e-05 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 61/34 ECSubWrite(tid=45, reqid=osd.8.0:45, at_version=61'36, trim_to=0'0, roll_forward_to=60'32))", 2024-09-17T16:42:49.682 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.509656+0000", 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.086102879, 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006059615, 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509656+0000", 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509656+0000", 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509657+0000", 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1900000000000001e-07 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509685+0000", 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8002999999999999e-05 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509698+0000", 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2785999999999999e-05 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509708+0000", 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7489999999999993e-06 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509769+0000", 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1393e-05 2024-09-17T16:42:49.685 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.509779+0000", 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0546e-05 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515686+0000", 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059067290000000003 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.686 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515716+0000", 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9490000000000001e-05 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=150, reqid=osd.5.0:150, at_version=61'95, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.085138606999999, 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071525119999999998, 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.687 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510621+0000", 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4099999999999997e-07 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510647+0000", 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5749999999999999e-05 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510664+0000", 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7388999999999999e-05 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.690 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.690 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510674+0000", 2024-09-17T16:42:49.690 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0011e-05 2024-09-17T16:42:49.690 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.690 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.691 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.691 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510769+0000", 2024-09-17T16:42:49.691 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4370999999999995e-05 2024-09-17T16:42:49.691 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.691 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510779+0000", 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0302999999999999e-05 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517731+0000", 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069523679999999996 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517773+0000", 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1378999999999998e-05 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=151, reqid=client.4553.0:467, at_version=61'97, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.082828063999999, 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0096697429999999997, 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.693 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.694 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512932+0000", 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512962+0000", 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0382000000000002e-05 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512978+0000", 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6013000000000001e-05 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512997+0000", 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8839999999999999e-05 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513153+0000", 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000155969 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513163+0000", 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.031e-05 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522566+0000", 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094027599999999996 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522601+0000", 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4542000000000002e-05 2024-09-17T16:42:49.697 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 61/34 ECSubWrite(tid=46, reqid=osd.8.0:45, at_version=0'0, trim_to=0'0, roll_forward_to=61'36))", 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.517418+0000", 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.078340623000001, 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052181010000000002, 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.698 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517418+0000", 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517418+0000", 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517419+0000", 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.091e-06 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517433+0000", 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3311e-05 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517456+0000", 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3204e-05 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517466+0000", 2024-09-17T16:42:49.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0068000000000001e-05 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517537+0000", 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0588999999999998e-05 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517547+0000", 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0716999999999999e-05 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.701 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522608+0000", 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050605870000000001 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522636+0000", 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8534000000000002e-05 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=156, reqid=osd.5.0:156, at_version=61'103, trim_to=0'0, roll_forward_to=61'101))", 2024-09-17T16:42:49.702 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.528715+0000", 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.067043948, 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052235440000000001, 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528715+0000", 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.703 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528715+0000", 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528716+0000", 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7899999999999997e-07 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528739+0000", 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2886000000000001e-05 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.704 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528755+0000", 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6543999999999999e-05 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528765+0000", 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2499999999999995e-06 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528852+0000", 2024-09-17T16:42:49.705 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7076000000000005e-05 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.528863+0000", 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1017e-05 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.533877+0000", 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050146740000000002 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:49.706 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.533939+0000", 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1217999999999996e-05 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:49.707 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:49.708 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:49.706+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:49.709 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:49.809 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:49.806+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:49.829 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-17T16:42:49.826+0000 7f599a036640 -1 mon.a@0(leader).osd e76 definitely_dead 0 2024-09-17T16:42:49.852 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:49.852 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:49.852 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:49.852 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:49.860 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:49.910 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:49.908+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:50.003 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:50.003 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:50.004 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:50.004 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.011 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:50.012 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:50.009+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:50.112 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:50.110+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:50.117 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.117 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:50.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:50.117 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:50.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.118 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:50.118 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:50.118 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.631857584999999, 2024-09-17T16:42:50.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079208060000000007, 2024-09-17T16:42:50.118 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481603+0000", 2024-09-17T16:42:50.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.75e-07 2024-09-17T16:42:50.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482071+0000", 2024-09-17T16:42:50.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046812600000000002 2024-09-17T16:42:50.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482084+0000", 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3057000000000001e-05 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482091+0000", 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3540000000000002e-06 2024-09-17T16:42:50.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482223+0000", 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013139799999999999 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482253+0000", 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0824000000000002e-05 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489462+0000", 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007208356 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489523+0000", 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1216000000000005e-05 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.125 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.613715966000001, 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062455490000000004, 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499744+0000", 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499751+0000", 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8290000000000002e-06 2024-09-17T16:42:50.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500848+0000", 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001096889 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500866+0000", 2024-09-17T16:42:50.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8899999999999999e-05 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500877+0000", 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0709e-05 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500961+0000", 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3460000000000004e-05 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.500974+0000", 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3546e-05 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505946+0000", 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049713459999999998 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505989+0000", 2024-09-17T16:42:50.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3869999999999998e-05 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.601843380999998, 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066825230000000001, 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.131 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511617+0000", 2024-09-17T16:42:50.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512095+0000", 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00047857800000000001 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6481999999999999e-05 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512122+0000", 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0195e-05 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512212+0000", 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9619999999999999e-05 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512224+0000", 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1997999999999999e-05 2024-09-17T16:42:50.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518268+0000", 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060445969999999996 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518299+0000", 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0811e-05 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.620167091999999, 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007546713, 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:42:50.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493294+0000", 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.623e-06 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493665+0000", 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037080199999999999 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493684+0000", 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8737999999999999e-05 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493694+0000", 2024-09-17T16:42:50.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9429999999999995e-06 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493819+0000", 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012501100000000001 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0801999999999999e-05 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.500799+0000", 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00696892 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.500839+0000", 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0874000000000002e-05 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.141 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/34 ECSubWrite(tid=146, reqid=osd.4.0:146, at_version=60'57, trim_to=0'0, roll_forward_to=59'55))", 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.603908172000001, 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071068210000000001, 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2500000000000001e-07 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509577+0000", 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5307999999999999e-05 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509586+0000", 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3380000000000005e-06 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.510073+0000", 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048690000000000002 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.510157+0000", 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4516000000000002e-05 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.510168+0000", 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.131e-05 2024-09-17T16:42:50.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.516631+0000", 2024-09-17T16:42:50.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064626650000000002 2024-09-17T16:42:50.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.516658+0000", 2024-09-17T16:42:50.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7359e-05 2024-09-17T16:42:50.147 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.148 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.148 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.148 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:50.148 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:42:50.149 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.602235310000001, 2024-09-17T16:42:50.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081810830000000005, 2024-09-17T16:42:50.149 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.149 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.150 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.150 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:42:50.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:42:50.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511225+0000", 2024-09-17T16:42:50.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7099999999999998e-07 2024-09-17T16:42:50.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511251+0000", 2024-09-17T16:42:50.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6346000000000002e-05 2024-09-17T16:42:50.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511262+0000", 2024-09-17T16:42:50.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0501e-05 2024-09-17T16:42:50.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511272+0000", 2024-09-17T16:42:50.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9690000000000006e-06 2024-09-17T16:42:50.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511337+0000", 2024-09-17T16:42:50.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5390999999999998e-05 2024-09-17T16:42:50.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511347+0000", 2024-09-17T16:42:50.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8840000000000006e-06 2024-09-17T16:42:50.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519366+0000", 2024-09-17T16:42:50.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080189979999999994 2024-09-17T16:42:50.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519406+0000", 2024-09-17T16:42:50.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9722999999999999e-05 2024-09-17T16:42:50.159 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.159 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.159 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.159 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.159 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.160 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=60'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:50.160 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.513322+0000", 2024-09-17T16:42:50.160 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.600137816, 2024-09-17T16:42:50.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067843749999999996, 2024-09-17T16:42:50.160 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.161 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.161 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.161 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513322+0000", 2024-09-17T16:42:50.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513322+0000", 2024-09-17T16:42:50.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513323+0000", 2024-09-17T16:42:50.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3e-07 2024-09-17T16:42:50.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513340+0000", 2024-09-17T16:42:50.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6986e-05 2024-09-17T16:42:50.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513352+0000", 2024-09-17T16:42:50.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2029e-05 2024-09-17T16:42:50.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513358+0000", 2024-09-17T16:42:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8819999999999998e-06 2024-09-17T16:42:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.514498+0000", 2024-09-17T16:42:50.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00114095 2024-09-17T16:42:50.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.514514+0000", 2024-09-17T16:42:50.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5412000000000001e-05 2024-09-17T16:42:50.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.520075+0000", 2024-09-17T16:42:50.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0055611940000000002 2024-09-17T16:42:50.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.170 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.170 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.520106+0000", 2024-09-17T16:42:50.170 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1291999999999998e-05 2024-09-17T16:42:50.170 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.170 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.170 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.171 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.171 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.171 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:50.171 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:42:50.171 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.595150557, 2024-09-17T16:42:50.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015298559, 2024-09-17T16:42:50.172 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.172 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.172 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.173 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:42:50.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.174 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:42:50.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518310+0000", 2024-09-17T16:42:50.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.049e-06 2024-09-17T16:42:50.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518764+0000", 2024-09-17T16:42:50.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045328799999999999 2024-09-17T16:42:50.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518781+0000", 2024-09-17T16:42:50.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6999000000000001e-05 2024-09-17T16:42:50.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518789+0000", 2024-09-17T16:42:50.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8000000000000004e-06 2024-09-17T16:42:50.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518864+0000", 2024-09-17T16:42:50.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4679999999999996e-05 2024-09-17T16:42:50.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.180 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518876+0000", 2024-09-17T16:42:50.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1732e-05 2024-09-17T16:42:50.180 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.180 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.181 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533579+0000", 2024-09-17T16:42:50.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014703163 2024-09-17T16:42:50.181 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.181 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.182 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533608+0000", 2024-09-17T16:42:50.182 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8847999999999999e-05 2024-09-17T16:42:50.182 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.182 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.182 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.183 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:50.183 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526182+0000", 2024-09-17T16:42:50.183 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.587278227999999, 2024-09-17T16:42:50.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074684870000000002, 2024-09-17T16:42:50.184 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.184 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.184 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.184 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526182+0000", 2024-09-17T16:42:50.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526182+0000", 2024-09-17T16:42:50.186 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.186 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.187 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526183+0000", 2024-09-17T16:42:50.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0669999999999999e-06 2024-09-17T16:42:50.187 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.187 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.187 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.187 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526515+0000", 2024-09-17T16:42:50.188 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00033276099999999999 2024-09-17T16:42:50.188 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.188 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.188 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.188 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526536+0000", 2024-09-17T16:42:50.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0962e-05 2024-09-17T16:42:50.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526545+0000", 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0410000000000003e-06 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526610+0000", 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4678000000000007e-05 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526617+0000", 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8970000000000002e-06 2024-09-17T16:42:50.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533629+0000", 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070116550000000003 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533650+0000", 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1426000000000001e-05 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=151, reqid=client.4553.0:435, at_version=60'21, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.530125+0000", 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.583335001000002, 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0063923679999999998, 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530125+0000", 2024-09-17T16:42:50.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530125+0000", 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530126+0000", 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0699999999999999e-06 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530312+0000", 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018601699999999999 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530332+0000", 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.986e-05 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530342+0000", 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0069e-05 2024-09-17T16:42:50.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530845+0000", 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00050351499999999995 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530857+0000", 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1240000000000001e-05 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.536479+0000", 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056227669999999999 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.536517+0000", 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7830000000000002e-05 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:50.196 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.523825520999999, 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010959406, 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590206+0000", 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000570752 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590220+0000", 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4301000000000001e-05 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590226+0000", 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1279999999999996e-06 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590291+0000", 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4098999999999997e-05 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590299+0000", 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3659999999999992e-06 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600554+0000", 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010255060999999999 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600594+0000", 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9734000000000003e-05 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.519120650000001, 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077480170000000003, 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.201 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594340+0000", 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7199999999999998e-07 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594802+0000", 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046238699999999998 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594812+0000", 2024-09-17T16:42:50.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4490000000000005e-06 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594817+0000", 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4070000000000001e-06 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594873+0000", 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6187000000000003e-05 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594883+0000", 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0012e-05 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602063+0000", 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071793839999999996 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602087+0000", 2024-09-17T16:42:50.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4519e-05 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.fs4 61/34 ECSubWrite(tid=57, reqid=osd.13.0:57, at_version=61'8, trim_to=0'0, roll_forward_to=60'6))", 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.597605478, 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079238329999999999, 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.206 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.207 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515855+0000", 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.39e-07 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515885+0000", 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0670999999999998e-05 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515896+0000", 2024-09-17T16:42:50.208 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0227999999999999e-05 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515904+0000", 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516079+0000", 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017482700000000001 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.209 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516092+0000", 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2476e-05 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523739+0000", 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076475459999999999 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.210 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523778+0000", 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8964999999999997e-05 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 61/34 ECSubWrite(tid=56, reqid=osd.13.0:56, at_version=61'23, trim_to=0'0, roll_forward_to=60'21))", 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.597063472, 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081842100000000008, 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.211 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.212 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516397+0000", 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.71e-07 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516421+0000", 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4227e-05 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.213 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516436+0000", 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4278e-05 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516446+0000", 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0132999999999999e-05 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516504+0000", 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8096000000000001e-05 2024-09-17T16:42:50.214 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516511+0000", 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5930000000000002e-06 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524540+0000", 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080295439999999996 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.215 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524581+0000", 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0467999999999999e-05 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 61/34 ECSubWrite(tid=55, reqid=osd.0.0:55, at_version=61'49, trim_to=0'0, roll_forward_to=60'45))", 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.596436887999999, 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075496410000000002, 2024-09-17T16:42:50.216 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.217 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517024+0000", 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6800000000000009e-07 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517047+0000", 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2843000000000001e-05 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.218 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517063+0000", 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6124999999999999e-05 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517072+0000", 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7569999999999993e-06 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517136+0000", 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3989e-05 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.219 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517146+0000", 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9550000000000004e-06 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524476+0000", 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073308189999999997 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524573+0000", 2024-09-17T16:42:50.220 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6185000000000002e-05 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 61/34 ECSubWrite(tid=164, reqid=osd.4.0:164, at_version=61'37, trim_to=0'0, roll_forward_to=60'35))", 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.517262+0000", 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.596197343, 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072875530000000004, 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.221 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517262+0000", 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517262+0000", 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517263+0000", 2024-09-17T16:42:50.222 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3300000000000001e-07 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517280+0000", 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6945000000000001e-05 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517288+0000", 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4279999999999996e-06 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.223 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517297+0000", 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0410000000000003e-06 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517359+0000", 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2285000000000004e-05 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.224 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517367+0000", 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6909999999999997e-06 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524516+0000", 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071488100000000002 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524550+0000", 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4220000000000001e-05 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.225 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 61/34 ECSubWrite(tid=165, reqid=osd.4.0:165, at_version=61'24, trim_to=0'0, roll_forward_to=60'22))", 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.518537+0000", 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.594922729, 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067717569999999998, 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.226 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518537+0000", 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518537+0000", 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518550+0000", 2024-09-17T16:42:50.227 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3281e-05 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518586+0000", 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5549000000000001e-05 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518601+0000", 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5118e-05 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.228 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518610+0000", 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6389999999999998e-06 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518698+0000", 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8552000000000002e-05 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518711+0000", 2024-09-17T16:42:50.229 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2306999999999999e-05 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525273+0000", 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065627469999999999 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525309+0000", 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5564e-05 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.230 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 61/34 ECSubWrite(tid=166, reqid=osd.4.0:166, at_version=61'39, trim_to=0'0, roll_forward_to=60'35))", 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.594827938, 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066949940000000001, 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.231 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:42:50.232 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8700000000000001e-07 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518669+0000", 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7150000000000002e-05 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518684+0000", 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4980000000000001e-05 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.233 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518693+0000", 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1689999999999992e-06 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518751+0000", 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8168999999999998e-05 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518760+0000", 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5300000000000002e-06 2024-09-17T16:42:50.234 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525295+0000", 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065346170000000004 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525327+0000", 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1992000000000001e-05 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.235 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 11.659202341, 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088600729999999996, 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.236 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454258+0000", 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.237 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455027+0000", 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00076834799999999997 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455042+0000", 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5009e-05 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455048+0000", 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6560000000000003e-06 2024-09-17T16:42:50.238 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0324e-05 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455119+0000", 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0755e-05 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.239 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463081+0000", 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079613089999999997 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463118+0000", 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6878999999999997e-05 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.240 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 76/34 ECSubWrite(tid=63, reqid=client.4553.0:603, at_version=76'58, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.480897+0000", 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.63256285199999995, 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064193599999999998, 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.480897+0000", 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.241 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.480897+0000", 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.480898+0000", 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3900000000000004e-07 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481282+0000", 2024-09-17T16:42:50.242 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038432499999999998 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481292+0000", 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4760000000000004e-06 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481299+0000", 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6040000000000004e-06 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.243 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481352+0000", 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2389999999999998e-05 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481361+0000", 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4299999999999995e-06 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487277+0000", 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059156369999999996 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.244 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487316+0000", 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9659000000000001e-05 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.245 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.247 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:50.247 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:50.245+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:50.348 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:50.346+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:50.351 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.351 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:50.351 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:50.351 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.359 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:50.441 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:42:50.441 INFO:teuthology.orchestra.run.smithi060.stderr:marked out osd.13. 2024-09-17T16:42:50.447 INFO:tasks.rados.rados.0.smithi183.stdout:241: done (3 left) 2024-09-17T16:42:50.448 INFO:tasks.rados.rados.0.smithi183.stdout:242: done (2 left) 2024-09-17T16:42:50.448 INFO:tasks.rados.rados.0.smithi183.stdout:243: done (1 left) 2024-09-17T16:42:50.448 INFO:tasks.rados.rados.0.smithi183.stdout:244: done (0 left) 2024-09-17T16:42:50.448 INFO:tasks.rados.rados.0.smithi183.stdout:245: snap_remove snap 19 2024-09-17T16:42:50.450 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:50.448+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:50.466 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.466 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:50.466 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:50.466 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:50.466 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.475 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:50.550 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:50.548+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:50.579 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4353.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 55.462321682000002, 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019887846000000001, 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.580 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4353", 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 1 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.581 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114602+0000", 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4899999999999999e-06 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114608+0000", 2024-09-17T16:42:50.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5269999999999998e-06 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114617+0000", 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114624+0000", 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114751+0000", 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012672599999999999 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114762+0000", 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0988000000000001e-05 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133140+0000", 2024-09-17T16:42:50.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018378205000000002 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133255+0000", 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011454 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 5", 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133361+0000", 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134291+0000", 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00092989899999999998 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134428+0000", 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013742100000000001 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134460+0000", 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1696000000000003e-05 2024-09-17T16:42:50.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134488+0000", 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8839999999999998e-05 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:180 3.8s0 3:1f669f2f:::smithi18337221-38:head [copy-from ver 4] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 38.116378306000001, 2024-09-17T16:42:50.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539511, 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 180 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460545+0000", 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789999999999999e-06 2024-09-17T16:42:50.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460557+0000", 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1426e-05 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460574+0000", 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7201e-05 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460585+0000", 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1151e-05 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460659+0000", 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3627000000000005e-05 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460665+0000", 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8799999999999996e-06 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465756+0000", 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050914580000000001 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465824+0000", 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7695999999999997e-05 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.471499+0000", 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056752800000000004 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474733+0000", 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336159999999999 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475885+0000", 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011522209999999999 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475939+0000", 2024-09-17T16:42:50.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4075e-05 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:181 3.8s0 3:1f669f2f:::smithi18337221-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 38.116315460000003, 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012676972999999999, 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.594 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 181 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:50.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7700000000000005e-07 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460610+0000", 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.255e-06 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460615+0000", 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4210000000000003e-06 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460619+0000", 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9580000000000001e-06 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460721+0000", 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000101939 2024-09-17T16:42:50.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460728+0000", 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8040000000000004e-06 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466017+0000", 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052897680000000002 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466075+0000", 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7250999999999998e-05 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473120+0000", 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070448159999999998 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473208+0000", 2024-09-17T16:42:50.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8794000000000004e-05 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473284+0000", 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5489999999999997e-05 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:205 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~540672] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:50.600 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.090318416999999, 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022798883999999998, 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 205 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486616+0000", 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2235999999999999e-05 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487273+0000", 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065649800000000004 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487287+0000", 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4691e-05 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487297+0000", 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6360000000000006e-06 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488723+0000", 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014264239999999999 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488837+0000", 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011340000000000001 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490257+0000", 2024-09-17T16:42:50.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014198100000000001 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503813+0000", 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013556586000000001 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509302+0000", 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054885029999999996 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001011 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:206 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.087137908999999, 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020001278000000001, 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.606 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 206 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489787+0000", 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.193e-06 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490081+0000", 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029397100000000002 2024-09-17T16:42:50.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490112+0000", 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1084999999999998e-05 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490123+0000", 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1440999999999999e-05 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498510+0000", 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083867290000000008 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498626+0000", 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011602700000000001 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499572+0000", 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00094589999999999995 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504786+0000", 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005214148 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509716+0000", 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049301520000000001 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509786+0000", 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9632e-05 2024-09-17T16:42:50.611 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:207 3.8s0 3:1b608a02:::smithi18337221-50:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.086779728000003, 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020510362000000001, 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.612 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 207 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490149+0000", 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.135e-06 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490157+0000", 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9060000000000002e-06 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490162+0000", 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1229999999999999e-06 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505559+0000", 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539709 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505695+0000", 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135969 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506337+0000", 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064216000000000002 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507545+0000", 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012081609999999999 2024-09-17T16:42:50.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510574+0000", 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030285519999999999 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510653+0000", 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9348e-05 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:208 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.086751667000001, 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021610111000000001, 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 208 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.618 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:42:50.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490174+0000", 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7350000000000001e-06 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490181+0000", 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9890000000000003e-06 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490186+0000", 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2299999999999999e-06 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506594+0000", 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016408049000000001 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507224+0000", 2024-09-17T16:42:50.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000629881 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510953+0000", 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037285399999999998 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511114+0000", 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016097400000000001 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511781+0000", 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066716099999999999 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.078263368999998, 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086096929999999999, 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.623 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498659+0000", 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498660+0000", 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2399999999999996e-07 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498679+0000", 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9306000000000001e-05 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498692+0000", 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3247999999999999e-05 2024-09-17T16:42:50.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498711+0000", 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8244e-05 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503918+0000", 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052073960000000004 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503938+0000", 2024-09-17T16:42:50.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0027999999999999e-05 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507239+0000", 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0033006559999999999 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507269+0000", 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9890999999999999e-05 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.627 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s1 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.068480389999998, 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088156980000000003, 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:50.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508442+0000", 2024-09-17T16:42:50.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509059+0000", 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00061633200000000003 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509089+0000", 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9966000000000001e-05 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509098+0000", 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509196+0000", 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7888999999999997e-05 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.509204+0000", 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1289999999999996e-06 2024-09-17T16:42:50.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517216+0000", 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008012 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517258+0000", 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1189000000000002e-05 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 27.115487368, 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092754329999999996, 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461435+0000", 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0399999999999996e-07 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461889+0000", 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045319700000000002 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461900+0000", 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1837e-05 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461909+0000", 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3590000000000008e-06 2024-09-17T16:42:50.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461957+0000", 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8575999999999997e-05 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.461963+0000", 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7699999999999998e-06 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.470674+0000", 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0087108930000000008 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.470710+0000", 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6297000000000002e-05 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.637 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:368 3.8s0 3:1b608a02:::smithi18337221-50:b [read 1295654~457434,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 22.074264319000001, 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0099805280000000007, 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 368 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502659+0000", 2024-09-17T16:42:50.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502663+0000", 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0269999999999997e-06 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502670+0000", 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502676+0000", 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3269999999999997e-06 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510962+0000", 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082857139999999996 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.511066+0000", 2024-09-17T16:42:50.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010427199999999999 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512639+0000", 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015722690000000001 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.969982736999999, 2024-09-17T16:42:50.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011225425000000001, 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:42:50.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606941+0000", 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0869999999999999e-06 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607290+0000", 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034908900000000002 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607308+0000", 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8522999999999999e-05 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607322+0000", 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3582e-05 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607407+0000", 2024-09-17T16:42:50.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5463000000000005e-05 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607417+0000", 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6090000000000007e-06 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618132+0000", 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010714672999999999 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618165+0000", 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3399000000000003e-05 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.058215841999999, 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01393165, 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.647 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518707+0000", 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.47e-07 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519373+0000", 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066530699999999996 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519390+0000", 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7329e-05 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519407+0000", 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7022999999999999e-05 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519617+0000", 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000209564 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519641+0000", 2024-09-17T16:42:50.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4725000000000001e-05 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532562+0000", 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012920769 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532638+0000", 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5986000000000001e-05 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.050476453000002, 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0093138409999999998, 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:42:50.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526447+0000", 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7599999999999997e-07 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526616+0000", 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000169803 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526630+0000", 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3246e-05 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526638+0000", 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9859999999999994e-06 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527416+0000", 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00077817999999999995 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527426+0000", 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.012e-05 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.535735+0000", 2024-09-17T16:42:50.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083096039999999999 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.535760+0000", 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4226000000000001e-05 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=151, reqid=client.4553.0:435, at_version=60'21, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.530402+0000", 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.046519845999999, 2024-09-17T16:42:50.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083721860000000002, 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530402+0000", 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530402+0000", 2024-09-17T16:42:50.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530403+0000", 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8599999999999996e-07 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530455+0000", 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1844e-05 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530468+0000", 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.259e-05 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.530477+0000", 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6789999999999994e-06 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532759+0000", 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0022822060000000002 2024-09-17T16:42:50.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532769+0000", 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0317e-05 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.538734+0000", 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059645139999999998 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.538775+0000", 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1050000000000002e-05 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.987155126000001, 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011351075, 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.661 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589768+0000", 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5000000000000002e-07 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590376+0000", 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000607812 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590388+0000", 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1968e-05 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590393+0000", 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5929999999999996e-06 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590459+0000", 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5939999999999995e-05 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590466+0000", 2024-09-17T16:42:50.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8390000000000001e-06 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601035+0000", 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010569017999999999 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601118+0000", 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3154999999999999e-05 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.665 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 61/34 ECSubWrite(tid=149, reqid=osd.2.0:149, at_version=61'51, trim_to=0'0, roll_forward_to=60'49))", 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.063503435000001, 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097004719999999999, 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:50.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.41e-07 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513443+0000", 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4164000000000001e-05 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513452+0000", 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1449999999999997e-06 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.668 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513459+0000", 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1739999999999997e-06 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513548+0000", 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9395999999999996e-05 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513559+0000", 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1191e-05 2024-09-17T16:42:50.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522009+0000", 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0084501660000000003 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523119+0000", 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011099949999999999 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 61/34 ECSubWrite(tid=54, reqid=osd.0.0:54, at_version=61'47, trim_to=0'0, roll_forward_to=60'45))", 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.514438+0000", 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.062483869000001, 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0087893910000000006, 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514438+0000", 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514438+0000", 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514439+0000", 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5300000000000003e-07 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514466+0000", 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7046000000000002e-05 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514482+0000", 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5336e-05 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514491+0000", 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9260000000000006e-06 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514552+0000", 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1103000000000001e-05 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514561+0000", 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.166e-06 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523193+0000", 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008631807 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523228+0000", 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5154000000000003e-05 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 61/34 ECSubWrite(tid=150, reqid=osd.2.0:150, at_version=61'53, trim_to=0'0, roll_forward_to=60'49))", 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.514940+0000", 2024-09-17T16:42:50.675 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.061982321999999, 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083252989999999995, 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514940+0000", 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514940+0000", 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514941+0000", 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0100000000000001e-06 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514964+0000", 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.321e-05 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514978+0000", 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3769e-05 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514997+0000", 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8790000000000001e-05 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515079+0000", 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1823999999999995e-05 2024-09-17T16:42:50.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515088+0000", 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9059999999999997e-06 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523232+0000", 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081438840000000005 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523265+0000", 2024-09-17T16:42:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2906e-05 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.1005193609999999, 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0095130030000000008, 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:50.680 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:50.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3099999999999999e-07 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477138+0000", 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000735022 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477149+0000", 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.099e-05 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477157+0000", 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2290000000000003e-06 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477249+0000", 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1145999999999998e-05 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477258+0000", 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6989999999999998e-06 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.485884+0000", 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086257880000000006 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.485916+0000", 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1897999999999999e-05 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:50.684 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.686 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:50.686 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:50.684+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:50.773 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:50.787 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:50.785+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:50.829 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.829 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:50.829 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:42:50.829 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.837 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:50.888 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:50.886+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:50.904 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:50.904 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:50.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:50.923 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:50.939 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:50.940 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:42:50.940 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:42:50.940 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:42:50.940 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:50.940 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:50.940 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:50.949 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:50.957 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:50.957 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:50.973 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:50.973 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:50.989 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:50.987+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:50.990 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:50.990 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:51.007 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:51.007 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:51.025 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:51.025 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:51.041 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:51.041 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:51.053 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:51.053 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.560083921999997, 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080373609999999998, 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.054 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9900000000000001e-07 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490977+0000", 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000139412 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490997+0000", 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.052e-05 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491011+0000", 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4304999999999999e-05 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491130+0000", 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011833900000000001 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491143+0000", 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2986000000000001e-05 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498835+0000", 2024-09-17T16:42:51.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076927319999999999 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498874+0000", 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8668000000000003e-05 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:51.058 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.542716892999998, 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0091817740000000002, 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:51.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.91e-07 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508622+0000", 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041787699999999998 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508636+0000", 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4331999999999999e-05 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508644+0000", 2024-09-17T16:42:51.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508713+0000", 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9888000000000006e-05 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508723+0000", 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.713e-06 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517349+0000", 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086254179999999993 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517386+0000", 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6971000000000002e-05 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.063 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:270 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~655360] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.530485024000001, 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013861503000000001, 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 270 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520438+0000", 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0849999999999999e-06 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520784+0000", 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034672700000000002 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520799+0000", 2024-09-17T16:42:51.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4945e-05 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520809+0000", 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999997e-06 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520888+0000", 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9523000000000004e-05 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.521021+0000", 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013319300000000001 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522568+0000", 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015468770000000001 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085082820000000007 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:51.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534240+0000", 2024-09-17T16:42:51.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031634889999999998 2024-09-17T16:42:51.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534297+0000", 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:271 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.528089898000001, 2024-09-17T16:42:51.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01199191, 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 271 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522833+0000", 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.889e-06 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523129+0000", 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029651599999999998 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523150+0000", 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0537e-05 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523159+0000", 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2329999999999995e-06 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527318+0000", 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041587719999999998 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527398+0000", 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0752000000000002e-05 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527918+0000", 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051932300000000003 2024-09-17T16:42:51.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531167+0000", 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032495649999999998 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534786+0000", 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036188050000000001 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534823+0000", 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6517999999999998e-05 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:272 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.527741475999999, 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011828584, 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.076 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 272 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523180+0000", 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523184+0000", 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1989999999999999e-06 2024-09-17T16:42:51.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523202+0000", 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7932999999999999e-05 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523210+0000", 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5050000000000001e-06 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530456+0000", 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072466300000000004 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3615999999999995e-05 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530847+0000", 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032758 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531332+0000", 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048465900000000002 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534949+0000", 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036167159999999999 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535008+0000", 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9038e-05 2024-09-17T16:42:51.081 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:273 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.527698623999999, 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012586701, 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.082 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 273 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523223+0000", 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523226+0000", 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2150000000000001e-06 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:42:51.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9100000000000005e-06 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523241+0000", 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1899999999999998e-06 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531097+0000", 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078564370000000008 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531159+0000", 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535259+0000", 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041002670000000003 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535355+0000", 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5707999999999999e-05 2024-09-17T16:42:51.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535809+0000", 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045409299999999998 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:297 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~737280] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 27.568930600000002, 2024-09-17T16:42:51.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011819003, 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 297 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:51.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481992+0000", 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.001e-06 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482367+0000", 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037461699999999999 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482382+0000", 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5693e-05 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482389+0000", 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.08e-06 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482440+0000", 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0917000000000001e-05 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482445+0000", 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6410000000000001e-06 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484030+0000", 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001585328 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484091+0000", 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0677999999999997e-05 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.485118+0000", 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010273400000000001 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493041+0000", 2024-09-17T16:42:51.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079222289999999994 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493728+0000", 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00068753100000000001 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493809+0000", 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0947999999999998e-05 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.093 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:298 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 27.566566655999999, 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011840491999999999, 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 298 2024-09-17T16:42:51.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484355+0000", 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0249999999999999e-06 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484537+0000", 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018172699999999999 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484548+0000", 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1202999999999999e-05 2024-09-17T16:42:51.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484555+0000", 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4839999999999998e-06 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489700+0000", 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051447760000000002 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489765+0000", 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4311000000000001e-05 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.490228+0000", 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046323600000000001 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493079+0000", 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028515580000000001 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496152+0000", 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030726970000000001 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496195+0000", 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2475000000000002e-05 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.099 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:299 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 27.566348390999998, 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01186708, 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 299 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484573+0000", 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2399999999999998e-07 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484576+0000", 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4920000000000002e-06 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484582+0000", 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.096e-06 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484587+0000", 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2390000000000002e-06 2024-09-17T16:42:51.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492444+0000", 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078571289999999992 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492500+0000", 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5806000000000001e-05 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492763+0000", 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00026361899999999998 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493177+0000", 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041339600000000001 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496387+0000", 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032098970000000002 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496439+0000", 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2781999999999997e-05 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:300 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 27.566325358, 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012900164, 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.105 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 300 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484596+0000", 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.63e-07 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484599+0000", 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1690000000000001e-06 2024-09-17T16:42:51.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484607+0000", 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484612+0000", 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1379999999999998e-06 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492930+0000", 2024-09-17T16:42:51.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083180240000000003 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492979+0000", 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9021999999999999e-05 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496702+0000", 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037230459999999998 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:42:51.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496783+0000", 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1225999999999998e-05 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.497495+0000", 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00071229699999999997 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.539056202000001, 2024-09-17T16:42:51.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094427290000000004, 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511865+0000", 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4000000000000001e-07 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511882+0000", 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6923e-05 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511889+0000", 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9609999999999999e-06 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511895+0000", 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8889999999999996e-06 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511967+0000", 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1373999999999998e-05 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511978+0000", 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1080999999999999e-05 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521259+0000", 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092809539999999992 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521307+0000", 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8406999999999999e-05 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=60'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:51.114 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.537264787000002, 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083410159999999997, 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:42:51.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513657+0000", 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4200000000000005e-07 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513684+0000", 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7339999999999999e-05 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513698+0000", 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3611000000000001e-05 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513706+0000", 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6829999999999997e-06 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513924+0000", 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000217359 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513939+0000", 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5177000000000001e-05 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521961+0000", 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080218340000000003 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521997+0000", 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6170000000000001e-05 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.118 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.460991567000001, 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010035229, 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589930+0000", 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.105e-06 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590524+0000", 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059383899999999998 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590544+0000", 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0292000000000002e-05 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590555+0000", 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0344e-05 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590629+0000", 2024-09-17T16:42:51.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4610000000000006e-05 2024-09-17T16:42:51.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590640+0000", 2024-09-17T16:42:51.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0969e-05 2024-09-17T16:42:51.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599920+0000", 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092792629999999994 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599964+0000", 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4807e-05 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.594829+0000", 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.456091566000001, 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068391770000000001, 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594829+0000", 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594829+0000", 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594830+0000", 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9800000000000003e-07 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595169+0000", 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00033882200000000002 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595186+0000", 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6880000000000001e-05 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595195+0000", 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2639999999999997e-06 2024-09-17T16:42:51.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595660+0000", 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046495500000000002 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.595671+0000", 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0859999999999999e-05 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601636+0000", 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059654790000000001 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601668+0000", 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2119000000000002e-05 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=50, reqid=client.4553.0:456, at_version=60'44, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:51.129 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 17.452444499999999, 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007014335, 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598477+0000", 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598555+0000", 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8207000000000005e-05 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598570+0000", 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4885000000000001e-05 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598579+0000", 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0000000000000002e-06 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600037+0000", 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014582600000000001 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600047+0000", 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6010000000000001e-06 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.605456+0000", 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054086220000000001 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.605491+0000", 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.489e-05 2024-09-17T16:42:51.133 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 61/34 ECSubWrite(tid=30, reqid=osd.11.0:30, at_version=61'24, trim_to=0'0, roll_forward_to=60'22))", 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.537203469000001, 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068967539999999997, 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513718+0000", 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8500000000000002e-07 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513739+0000", 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1386000000000002e-05 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513747+0000", 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2700000000000004e-06 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513755+0000", 2024-09-17T16:42:51.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5490000000000001e-06 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513812+0000", 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6907999999999998e-05 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513819+0000", 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1760000000000004e-06 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520574+0000", 2024-09-17T16:42:51.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067552089999999999 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520614+0000", 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9971000000000001e-05 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 61/34 ECSubWrite(tid=70, reqid=osd.14.0:70, at_version=61'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.514010+0000", 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.536910251999998, 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.006612639, 2024-09-17T16:42:51.138 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514010+0000", 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514010+0000", 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514011+0000", 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5000000000000002e-07 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514027+0000", 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514037+0000", 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5789999999999993e-06 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514043+0000", 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6950000000000003e-06 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514096+0000", 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2386000000000003e-05 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.514104+0000", 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4030000000000007e-06 2024-09-17T16:42:51.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520595+0000", 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064905190000000001 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520623+0000", 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8272e-05 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 62/34 ECSubWrite(tid=75, reqid=osd.14.0:75, at_version=62'47, trim_to=0'0, roll_forward_to=61'43))", 2024-09-17T16:42:51.142 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.604315665, 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078703769999999996, 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:42:51.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446606+0000", 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0690000000000001e-06 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446635+0000", 2024-09-17T16:42:51.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8538999999999999e-05 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446647+0000", 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2617e-05 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446656+0000", 2024-09-17T16:42:51.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4700000000000002e-06 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.447766+0000", 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001110516 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.447778+0000", 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1338999999999999e-05 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.454450+0000", 2024-09-17T16:42:51.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066719530000000004 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.454475+0000", 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5874e-05 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s4 62/34 ECSubWrite(tid=48, reqid=osd.8.0:48, at_version=62'40, trim_to=0'0, roll_forward_to=61'36))", 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.601449401, 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074745189999999998, 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449472+0000", 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9299999999999998e-07 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449495+0000", 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3354e-05 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449505+0000", 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9210000000000004e-06 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449513+0000", 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6939999999999995e-06 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.450155+0000", 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064195400000000003 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.450164+0000", 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5959999999999993e-06 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.456910+0000", 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067456679999999998 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.456946+0000", 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5738999999999998e-05 2024-09-17T16:42:51.151 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.5744471500000001, 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010964612, 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9399999999999999e-07 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476883+0000", 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000408978 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476900+0000", 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6883000000000001e-05 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476910+0000", 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0842999999999999e-05 2024-09-17T16:42:51.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476992+0000", 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.161e-05 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477005+0000", 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2581e-05 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:42:51.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487394+0000", 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01038942 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487438+0000", 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4103000000000001e-05 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:42:51.156 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:42:51.157 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:51.158 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:51.158 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:51.159 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:51.159 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:51.156+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:51.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:51.160 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:51.161 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:51.161 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:51.162 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:51.144+0000 7ff546d95640 0 -- 172.21.15.60:0/583004893 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7ff540221ba0 msgr2=0x7ff540222030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:51.258 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:51.256+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:51.270 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:51.270 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:51.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:51.360 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:51.358+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:51.365 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:51.365 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:51.386 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:51.386 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:51.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:51.446 INFO:tasks.rados.rados.0.smithi183.stdout:245: done (0 left) 2024-09-17T16:42:51.447 INFO:tasks.rados.rados.0.smithi183.stdout:246: read oid 37 snap -1 2024-09-17T16:42:51.447 INFO:tasks.rados.rados.0.smithi183.stdout:246: expect (ObjNum 71 snap 10 seq_num 71) 2024-09-17T16:42:51.447 INFO:tasks.rados.rados.0.smithi183.stdout:247: rollback oid 39 current snap is 24 2024-09-17T16:42:51.447 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 39 to 22 2024-09-17T16:42:51.447 INFO:tasks.rados.rados.0.smithi183.stdout:248: snap_remove snap 21 2024-09-17T16:42:51.461 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:51.459+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:51.562 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:51.560+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:51.574 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:51.574 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:51.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:51.666 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:51.664+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:51.730 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:51.731 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:51.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:51.765 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:51.763+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:51.865 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:51.863+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:51.886 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:51.886 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:51.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:51.979 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:51.977+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:52.042 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.042 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:52.068 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:52.066+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:52.169 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:52.166+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:52.199 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.199 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:52.269 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:52.267+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:52.314 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.315 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:52.371 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:52.370+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:52.429 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.429 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:52.447 INFO:tasks.rados.rados.0.smithi183.stdout:248: done (2 left) 2024-09-17T16:42:52.447 INFO:tasks.rados.rados.0.smithi183.stdout:249: delete oid 18 current snap is 24 2024-09-17T16:42:52.447 INFO:tasks.rados.rados.0.smithi183.stdout:246: expect (ObjNum 71 snap 10 seq_num 71) 2024-09-17T16:42:52.447 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:52.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:42:52.470 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:52.482 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:52.480+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:52.494 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 928331 2024-09-17T16:42:52.504 INFO:tasks.rados.rados.0.smithi183.stdout:247: finishing rollback tid 0 to smithi18337221-39 2024-09-17T16:42:52.504 INFO:tasks.rados.rados.0.smithi183.stdout:247: finishing rollback tid 1 to smithi18337221-39 2024-09-17T16:42:52.504 INFO:tasks.rados.rados.0.smithi183.stdout:247: finishing rollback tid 2 to smithi18337221-39 2024-09-17T16:42:52.504 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 39 v 16 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-17T16:42:52.504 INFO:tasks.rados.rados.0.smithi183.stdout:246: done (2 left) 2024-09-17T16:42:52.505 INFO:tasks.rados.rados.0.smithi183.stdout:247: done (1 left) 2024-09-17T16:42:52.505 INFO:tasks.rados.rados.0.smithi183.stdout:249: done (0 left) 2024-09-17T16:42:52.505 INFO:tasks.rados.rados.0.smithi183.stdout:250: snap_remove snap 20 2024-09-17T16:42:52.560 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.560 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:52.573 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:52.571+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:52.673 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:52.671+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:52.680 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.680 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:52.775 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:52.773+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:52.796 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.796 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.804 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:52.877 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:52.875+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:52.913 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:52.913 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:52.921 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:42:52.977 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:52.975+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:53.024 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:53.024 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:53.032 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:42:53.078 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:53.076+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:53.177 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:53.177 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:53.179 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:53.176+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:53.185 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:42:53.279 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:53.277+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:53.287 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:53.295 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:42:53.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:53.379 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:53.377+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:53.398 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:53.398 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:53.406 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:42:53.475 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:42:53.479 INFO:tasks.rados.rados.0.smithi183.stdout:250: done (0 left) 2024-09-17T16:42:53.479 INFO:tasks.rados.rados.0.smithi183.stdout:251: snap_create 2024-09-17T16:42:53.480 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:53.477+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:53.521 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:53.521 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:53.538 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:53.538 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:53.555 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:53.555 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:53.556 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:53.556 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:53.564 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:42:53.574 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:53.574 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:53.590 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:53.590 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:53.607 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:53.607 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:53.608 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:53.606+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:53.624 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:53.624 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:53.642 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:53.642 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:53.658 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:53.659 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:53.668 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:53.668 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:53.675 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:53.676 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:53.677 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:42:53.681 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:53.679+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:53.693 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:53.693 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:53.710 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:53.710 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:53.726 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:53.726 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:53.743 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:53.743 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:53.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:53.742+0000 7fc527fff640 0 -- 172.21.15.60:0/2311332632 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fc53021cad0 msgr2=0x7fc53021eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:42:53.760 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:53.761 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:53.778 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:53.778 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:53.782 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:53.780+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:53.820 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:53.820 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:53.820 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:53.820 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:53.820 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:53.828 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:42:53.883 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:42:53.882+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:42:53.931 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:53.931 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.428480256, 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091284039999999997, 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.932 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500288+0000", 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8799999999999998e-07 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.933 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500609+0000", 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000321482 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500624+0000", 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4558e-05 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500632+0000", 2024-09-17T16:42:53.934 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500693+0000", 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1045999999999998e-05 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500703+0000", 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9899999999999992e-06 2024-09-17T16:42:53.935 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509375+0000", 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086724420000000007 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509416+0000", 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0639000000000002e-05 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.936 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.406007912, 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010249355999999999, 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.937 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2e-07 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523388+0000", 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062798599999999997 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523412+0000", 2024-09-17T16:42:53.939 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3898999999999999e-05 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523422+0000", 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0259e-05 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523489+0000", 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7070000000000007e-05 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.940 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523500+0000", 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0617e-05 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532963+0000", 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009463183 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533009+0000", 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5921999999999998e-05 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.941 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=20, reqid=client.4553.0:271, at_version=46'13, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.400684237999997, 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053659780000000004, 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.942 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528084+0000", 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.943 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228254 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528326+0000", 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.366e-05 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528334+0000", 2024-09-17T16:42:53.944 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3000000000000002e-06 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529561+0000", 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226293 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529570+0000", 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5820000000000008e-06 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.945 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533417+0000", 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003846576 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533449+0000", 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2694000000000002e-05 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:53.946 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.443636333000001, 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081612969999999996, 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:42:53.947 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485132+0000", 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5699999999999999e-07 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485905+0000", 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077313100000000004 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.948 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485917+0000", 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2092999999999999e-05 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485924+0000", 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7700000000000004e-06 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485987+0000", 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3487999999999999e-05 2024-09-17T16:42:53.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485998+0000", 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0917000000000001e-05 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493262+0000", 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072639489999999996 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493293+0000", 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0791999999999999e-05 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.414024148999999, 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014931335, 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.951 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.952 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.99e-07 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515242+0000", 2024-09-17T16:42:53.953 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049758300000000001 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515257+0000", 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.502e-05 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515265+0000", 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.954 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515335+0000", 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9536000000000006e-05 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515345+0000", 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9240000000000002e-06 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.955 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529639+0000", 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014294526 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529675+0000", 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.956 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.407002995999999, 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081458920000000001, 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.957 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521766+0000", 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5700000000000001e-07 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522010+0000", 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024482600000000002 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.958 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522025+0000", 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.484e-05 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522035+0000", 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000001e-06 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522101+0000", 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5848999999999999e-05 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.959 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522111+0000", 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0122000000000001e-05 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529879+0000", 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077677559999999998 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529911+0000", 2024-09-17T16:42:53.960 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.322137762000001, 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048852510000000002, 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.961 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606632+0000", 2024-09-17T16:42:53.962 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.547e-06 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607055+0000", 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042362999999999998 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607075+0000", 2024-09-17T16:42:53.963 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0128000000000001e-05 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607086+0000", 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0705e-05 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607170+0000", 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4061999999999996e-05 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.964 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607181+0000", 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1430000000000001e-05 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611472+0000", 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042906589999999996 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611515+0000", 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T16:42:53.965 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.317371472000001, 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008221562, 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.966 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611397+0000", 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.71e-07 2024-09-17T16:42:53.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611941+0000", 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000544269 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611963+0000", 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1710999999999999e-05 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.968 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611973+0000", 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612053+0000", 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0012999999999994e-05 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612087+0000", 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4171999999999997e-05 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.969 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619590+0000", 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075029110000000001 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619618+0000", 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7461999999999999e-05 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=35, reqid=client.4553.0:396, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:53.970 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.310299788000002, 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062462430000000003, 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:42:53.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618469+0000", 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618513+0000", 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618529+0000", 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6183000000000001e-05 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618538+0000", 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618616+0000", 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8300999999999995e-05 2024-09-17T16:42:53.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618627+0000", 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0750999999999999e-05 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624677+0000", 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060503570000000001 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624714+0000", 2024-09-17T16:42:53.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6786999999999999e-05 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 24.436311404000001, 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079871060000000008, 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.975 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492457+0000", 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-07 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492641+0000", 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184215 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492656+0000", 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279000000000001e-05 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492704+0000", 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7738000000000003e-05 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492882+0000", 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177906 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492916+0000", 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4110999999999999e-05 2024-09-17T16:42:53.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500404+0000", 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074877750000000003 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500443+0000", 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9724000000000001e-05 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 60/34 ECSubWrite(tid=51, reqid=osd.15.0:51, at_version=60'32, trim_to=0'0, roll_forward_to=59'30))", 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.419865395999999, 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005118587, 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508903+0000", 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-07 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508925+0000", 2024-09-17T16:42:53.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2251000000000001e-05 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508934+0000", 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8240000000000006e-06 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508941+0000", 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7579999999999992e-06 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508998+0000", 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6230999999999997e-05 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509007+0000", 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4879999999999996e-06 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.513970+0000", 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049629039999999998 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514021+0000", 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0841999999999999e-05 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 60/34 ECSubWrite(tid=134, reqid=client.4553.0:430, at_version=60'22, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.418793045000001, 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049015120000000002, 2024-09-17T16:42:53.984 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509994+0000", 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8853000000000001e-05 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510005+0000", 2024-09-17T16:42:53.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0658e-05 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510012+0000", 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4950000000000002e-06 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510068+0000", 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5566999999999998e-05 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510077+0000", 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1349999999999998e-06 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514842+0000", 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047653260000000003 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514876+0000", 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3782000000000003e-05 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.988 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.339132691, 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099594590000000004, 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589636+0000", 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.124e-06 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590162+0000", 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052565200000000004 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590177+0000", 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5627000000000001e-05 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590187+0000", 2024-09-17T16:42:53.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4439999999999997e-06 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590255+0000", 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7867000000000006e-05 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590264+0000", 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0799999999999995e-06 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599543+0000", 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009279374 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599595+0000", 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1291000000000001e-05 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.993 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.334447765, 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065491719999999998, 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594321+0000", 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000005e-07 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594830+0000", 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050941699999999996 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594845+0000", 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4535999999999999e-05 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594855+0000", 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0344e-05 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595268+0000", 2024-09-17T16:42:53.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041257099999999998 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595278+0000", 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.048e-05 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600836+0000", 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055574250000000004 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600869+0000", 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3408999999999998e-05 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 62/34 ECSubWrite(tid=58, reqid=osd.0.0:58, at_version=62'53, trim_to=0'0, roll_forward_to=61'49))", 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.485170328999999, 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067202670000000003, 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:53.998 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443598+0000", 2024-09-17T16:42:53.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443624+0000", 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5219999999999999e-05 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443638+0000", 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4470999999999999e-05 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443647+0000", 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4199999999999996e-06 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444249+0000", 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060141600000000002 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444255+0000", 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4080000000000003e-06 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450282+0000", 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060268819999999999 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450318+0000", 2024-09-17T16:42:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5553000000000003e-05 2024-09-17T16:42:54.003 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.4789508310000006, 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075788619999999996, 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-17T16:42:54.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449939+0000", 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122082 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449951+0000", 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.129e-05 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449960+0000", 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4040000000000001e-06 2024-09-17T16:42:54.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450024+0000", 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3781999999999993e-05 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450034+0000", 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0039e-05 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457345+0000", 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073110359999999999 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457396+0000", 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0732999999999997e-05 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:42:54.008 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.4708568490000005, 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715298, 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457912+0000", 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.15e-06 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458033+0000", 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121348 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.010 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458055+0000", 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1265000000000001e-05 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458066+0000", 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1483e-05 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458134+0000", 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7743000000000005e-05 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458144+0000", 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0151e-05 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468594+0000", 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010449974000000001 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468626+0000", 2024-09-17T16:42:54.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2184000000000002e-05 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.4660553249999992, 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087638739999999996, 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462724+0000", 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1761e-05 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462852+0000", 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012799600000000001 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462869+0000", 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6850999999999998e-05 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462879+0000", 2024-09-17T16:42:54.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5400000000000001e-06 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462938+0000", 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9449e-05 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462947+0000", 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0909999999999999e-06 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471444+0000", 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084973329999999993 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471476+0000", 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853000000000001e-05 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:42:54.017 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4526867289999998, 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010450760999999999, 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476564+0000", 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048279099999999999 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476577+0000", 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3351e-05 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476587+0000", 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8379999999999997e-06 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476667+0000", 2024-09-17T16:42:54.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9798999999999999e-05 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476680+0000", 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2764e-05 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486459+0000", 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097787150000000003 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486532+0000", 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3231000000000004e-05 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 76/34 ECSubWrite(tid=63, reqid=client.4553.0:603, at_version=76'58, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:49.480924+0000", 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4478436129999999, 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059694029999999999, 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.022 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.480924+0000", 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.480924+0000", 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.480925+0000", 2024-09-17T16:42:54.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481271+0000", 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034631400000000002 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481284+0000", 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3173000000000001e-05 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481291+0000", 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6340000000000003e-06 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481341+0000", 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0285999999999999e-05 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481348+0000", 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5259999999999999e-06 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486866+0000", 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055183180000000004 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486894+0000", 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7322e-05 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.026 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:54.028 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:42:54.028 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:54.026+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:54.129 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:54.127+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:54.170 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:54.170 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:54.170 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:54.171 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:54.178 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:42:54.229 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:54.227+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:54.280 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:54.281 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:54.281 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:42:54.281 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:42:54.281 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:54.289 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:42:54.330 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:54.328+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:259 3.as0 3:50831259:::smithi18337221-29:head [append 0~638976] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.882371714000001, 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022736635000000002, 2024-09-17T16:42:54.393 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 259 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.394 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507573+0000", 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508317+0000", 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074403399999999997 2024-09-17T16:42:54.395 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508341+0000", 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4454999999999999e-05 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508353+0000", 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2255e-05 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.396 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508427+0000", 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3428000000000002e-05 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508437+0000", 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8279999999999998e-06 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510471+0000", 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020343150000000001 2024-09-17T16:42:54.397 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510530+0000", 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9429999999999999e-05 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511483+0000", 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000952596 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.398 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522459+0000", 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010975805 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530227+0000", 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077686020000000003 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530307+0000", 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9647000000000005e-05 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.399 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:260 3.as0 3:50831259:::smithi18337221-29:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.880381788000001, 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020894380000000001, 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.400 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.401 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509561+0000", 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0470000000000001e-06 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.402 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510123+0000", 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00056148700000000005 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510133+0000", 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.025e-05 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510140+0000", 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0129999999999996e-06 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.403 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519266+0000", 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091254409999999998 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519325+0000", 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9122000000000001e-05 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519798+0000", 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047354100000000001 2024-09-17T16:42:54.404 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523708+0000", 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039092340000000001 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530404+0000", 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066966009999999999 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.405 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530455+0000", 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0643999999999998e-05 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:261 3.as0 3:50831259:::smithi18337221-29:head [setxattr _header (56) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.879789258000002, 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439715000000001, 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.406 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 261 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.407 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510154+0000", 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.16e-07 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510157+0000", 2024-09-17T16:42:54.408 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5949999999999999e-06 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510163+0000", 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.993e-06 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510168+0000", 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8620000000000002e-06 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.409 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522482+0000", 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012313691 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522554+0000", 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1983999999999994e-05 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522957+0000", 2024-09-17T16:42:54.410 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040297599999999999 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.524157+0000", 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011998950000000001 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063637449999999996 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.411 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530593+0000", 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2157999999999996e-05 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:262 3.as0 3:50831259:::smithi18337221-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.879766824000001, 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021519231999999999, 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.412 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 262 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.413 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510176+0000", 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4700000000000002e-07 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510178+0000", 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9649999999999998e-06 2024-09-17T16:42:54.414 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510184+0000", 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2489999999999998e-06 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510189+0000", 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9649999999999999e-06 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.415 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523572+0000", 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013382955 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523660+0000", 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8460000000000003e-05 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530953+0000", 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072929079999999999 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.416 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.531043+0000", 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9289000000000005e-05 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.531695+0000", 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065199400000000003 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.417 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s3 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 34.867100237999999, 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011272473, 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.418 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.48e-07 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523557+0000", 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071461699999999996 2024-09-17T16:42:54.419 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523570+0000", 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2876e-05 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523578+0000", 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2339999999999994e-06 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.420 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523644+0000", 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6023000000000001e-05 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523653+0000", 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9570000000000008e-06 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.534081+0000", 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010428031000000001 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.421 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.534114+0000", 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3487e-05 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 30.928651715000001, 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011363906, 2024-09-17T16:42:54.422 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.423 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461291+0000", 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3700000000000001e-07 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461780+0000", 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048932100000000003 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.424 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461798+0000", 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461808+0000", 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0628000000000001e-05 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461901+0000", 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2238999999999996e-05 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.425 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461919+0000", 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8389999999999998e-05 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.472621+0000", 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701965000000001 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.472654+0000", 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3382e-05 2024-09-17T16:42:54.426 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.cs2 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.903521232999999, 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009062779, 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.427 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.428 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486422+0000", 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1900000000000001e-07 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486443+0000", 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1484999999999998e-05 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486460+0000", 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6645000000000001e-05 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.429 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486467+0000", 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4499999999999998e-06 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486524+0000", 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7099999999999999e-05 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486531+0000", 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3160000000000002e-06 2024-09-17T16:42:54.430 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.495444+0000", 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089135640000000006 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.495484+0000", 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9400000000000002e-05 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.431 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:386 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~524288] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.793400119000001, 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014318277000000001, 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 386 2024-09-17T16:42:54.432 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.433 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596544+0000", 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.734e-06 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597029+0000", 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048475200000000002 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597043+0000", 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4173e-05 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.434 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597050+0000", 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597102+0000", 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1535e-05 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597175+0000", 2024-09-17T16:42:54.435 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3429000000000005e-05 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598023+0000", 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084855 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610455+0000", 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012431143 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.436 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610790+0000", 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033497699999999997 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610860+0000", 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0720000000000001e-05 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.437 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:387 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~524288] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.79036357, 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014991211000000001, 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 387 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.438 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599580+0000", 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.291e-06 2024-09-17T16:42:54.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600184+0000", 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060389600000000003 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600201+0000", 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.681e-05 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.440 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600209+0000", 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604101+0000", 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038916070000000001 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604228+0000", 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126787 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.441 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605024+0000", 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079670200000000004 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610981+0000", 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059569289999999997 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614498+0000", 2024-09-17T16:42:54.442 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035168930000000001 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614570+0000", 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1735000000000004e-05 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:388 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~245760] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:42:54.443 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.789006616000002, 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016358692000000001, 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 388 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.444 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600937+0000", 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.445 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601238+0000", 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030118700000000002 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601251+0000", 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2916e-05 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601258+0000", 2024-09-17T16:42:54.446 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611153+0000", 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098949710000000007 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611232+0000", 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8889999999999999e-05 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.447 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611928+0000", 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069601799999999996 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614731+0000", 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028030020000000002 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617241+0000", 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025097890000000001 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.448 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617294+0000", 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3643999999999997e-05 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:389 3.as0 3:53f17c76:::smithi18337221-27:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.788672502000001, 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016157145000000001, 2024-09-17T16:42:54.449 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 389 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.450 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.92e-07 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601274+0000", 2024-09-17T16:42:54.451 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3289999999999998e-06 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601282+0000", 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2009999999999999e-06 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601288+0000", 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000002e-06 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.452 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.613675+0000", 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012386642 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.613763+0000", 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7653999999999998e-05 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614215+0000", 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000451939 2024-09-17T16:42:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.616836+0000", 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002621483 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617370+0000", 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000534243 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.454 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617427+0000", 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6431999999999998e-05 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:390 3.as0 3:53f17c76:::smithi18337221-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.788646420999999, 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017251170999999999, 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.455 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 390 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.456 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4000000000000002e-07 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601298+0000", 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2859999999999998e-06 2024-09-17T16:42:54.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601306+0000", 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6820000000000003e-06 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601311+0000", 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0869999999999997e-06 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.458 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614799+0000", 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013488061000000001 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614854+0000", 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4469000000000003e-05 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617735+0000", 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002881125 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.459 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617783+0000", 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7617999999999997e-05 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618547+0000", 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076440299999999998 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.460 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.1s1 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 20.871064796999999, 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012458881, 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.461 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518878+0000", 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2900000000000003e-07 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519191+0000", 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313271 2024-09-17T16:42:54.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519201+0000", 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8900000000000002e-06 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519206+0000", 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1340000000000003e-06 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.463 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519254+0000", 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7649999999999999e-05 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519264+0000", 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0309000000000001e-05 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.531316+0000", 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012051976000000001 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.464 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.531336+0000", 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0021999999999999e-05 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.cs2 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.452541+0000", 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.937400812, 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012693558000000001, 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.465 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452541+0000", 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.466 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452541+0000", 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452542+0000", 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8500000000000002e-07 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452798+0000", 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025625099999999998 2024-09-17T16:42:54.467 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452813+0000", 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.468e-05 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452821+0000", 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0290000000000005e-06 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.468 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.453090+0000", 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269294 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.453102+0000", 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2362e-05 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.465196+0000", 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012094077 2024-09-17T16:42:54.469 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.465235+0000", 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8479999999999997e-05 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:501 3.as0 3:5b2a661d:::smithi18337221-31:head [append 0~753664] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.451672+0000", 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.938270145000001, 2024-09-17T16:42:54.470 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019340112, 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 501 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.471 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.451672+0000", 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.451672+0000", 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.451673+0000", 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4649999999999999e-06 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.472 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453004+0000", 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013307810000000001 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453020+0000", 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6141999999999999e-05 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.473 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453030+0000", 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0068000000000001e-05 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453078+0000", 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7042000000000001e-05 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453147+0000", 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9129999999999997e-05 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.474 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454127+0000", 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098032700000000002 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467347+0000", 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013219684000000001 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.470950+0000", 2024-09-17T16:42:54.475 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036033940000000002 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471012+0000", 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2079e-05 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:502 3.as0 3:5b2a661d:::smithi18337221-31:head [append 0~720896] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.455702+0000", 2024-09-17T16:42:54.476 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.934240644999999, 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015930025, 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 502 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.455702+0000", 2024-09-17T16:42:54.477 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.455702+0000", 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.455704+0000", 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6299999999999998e-06 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.478 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456465+0000", 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000760906 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456480+0000", 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4671999999999999e-05 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456488+0000", 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2369999999999992e-06 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.479 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462008+0000", 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055201190000000004 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462099+0000", 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0882000000000002e-05 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462955+0000", 2024-09-17T16:42:54.480 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085584699999999997 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469310+0000", 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006355126 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471591+0000", 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002280621 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.481 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471632+0000", 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0985000000000001e-05 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:503 3.as0 3:5b2a661d:::smithi18337221-31:head [append 0~49152] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.456509+0000", 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.933432705, 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017705940999999999, 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.482 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 503 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456509+0000", 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.483 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456509+0000", 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456510+0000", 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6800000000000009e-07 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456539+0000", 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8476e-05 2024-09-17T16:42:54.484 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456548+0000", 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456557+0000", 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3649999999999993e-06 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.485 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467364+0000", 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010807173 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467428+0000", 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3936999999999994e-05 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467913+0000", 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048495500000000002 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.486 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469445+0000", 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015320760000000001 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.474171+0000", 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047256700000000004 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.474215+0000", 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4650000000000001e-05 2024-09-17T16:42:54.487 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:504 3.as0 3:5b2a661d:::smithi18337221-31:head [setxattr _header (57) in=7b] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.456564+0000", 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.933378015000001, 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020464788000000001, 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.488 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 504 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456564+0000", 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456564+0000", 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.489 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456565+0000", 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8700000000000001e-07 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456566+0000", 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9319999999999999e-06 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.490 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456570+0000", 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5480000000000002e-06 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456573+0000", 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9720000000000001e-06 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.468615+0000", 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012041559 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.491 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.468733+0000", 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011834500000000001 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469118+0000", 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038559599999999999 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471393+0000", 2024-09-17T16:42:54.492 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022749060000000002 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.476977+0000", 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055831839999999997 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.477029+0000", 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2358999999999998e-05 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.493 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:505 3.as0 3:5b2a661d:::smithi18337221-31:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.933365459999999, 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021479267, 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 505 2024-09-17T16:42:54.494 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.495 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-07 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456580+0000", 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456585+0000", 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0540000000000002e-06 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.496 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456588+0000", 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.881e-06 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469636+0000", 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013048844 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469690+0000", 2024-09-17T16:42:54.497 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3695e-05 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.477362+0000", 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076723879999999996 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.477450+0000", 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7482e-05 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.498 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.478056+0000", 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060605299999999995 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:552 3.as0 3:53f17c76:::smithi18337221-27:head [delete] snapc 14=[14,13,f] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.454621+0000", 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.9353214380000008, 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093139629999999998, 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:42:54.499 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 552 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454621+0000", 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.500 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454621+0000", 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454623+0000", 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.17e-06 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454631+0000", 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6990000000000003e-06 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.501 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454647+0000", 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6509999999999999e-05 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454656+0000", 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5269999999999998e-06 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454729+0000", 2024-09-17T16:42:54.502 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3616999999999997e-05 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454842+0000", 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113133 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455830+0000", 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098809700000000006 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.503 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458218+0000", 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023873940000000001 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.463842+0000", 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056238850000000003 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.463935+0000", 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2930999999999995e-05 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.504 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.505 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:42:54.505 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:42:54.505 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:54.507 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:42:54.507 INFO:tasks.rados.rados.0.smithi183.stdout:251: done (0 left) 2024-09-17T16:42:54.507 INFO:tasks.rados.rados.0.smithi183.stdout:252: read oid 46 snap -1 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:252: expect deleted 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:253: rollback oid 8 current snap is 25 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 8 to 18 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:254: rmattr oid 49 current snap is 25 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:254: done (2 left) 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:255: snap_create 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:253: finishing rollback tid 0 to smithi18337221-8 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:253: finishing rollback tid 1 to smithi18337221-8 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:253: finishing rollback tid 2 to smithi18337221-8 2024-09-17T16:42:54.508 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 8 v 159 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-09-17T16:42:54.508 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:54.504+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:54.607 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:54.605+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:54.619 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:54.620 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:54.620 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:54.628 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:42:54.708 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:54.706+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:54.771 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:54.771 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:54.771 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:54.779 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:42:54.824 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:42:54.822+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:42:54.882 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:54.882 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4255.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 69.984664339000005, 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086420360000000005, 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4255", 2024-09-17T16:42:54.883 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/3969910625", 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 76 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.884 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894839+0000", 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.75e-07 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894845+0000", 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8599999999999998e-06 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.885 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894852+0000", 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4330000000000001e-06 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.894858+0000", 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7429999999999996e-06 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.900998+0000", 2024-09-17T16:42:54.886 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061399779999999999 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.901039+0000", 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1009e-05 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op_commit", 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903413+0000", 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0023735090000000002 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.887 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903442+0000", 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9348000000000001e-05 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:41:44.903481+0000", 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8680999999999998e-05 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.888 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s4 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.357032541999999, 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091363109999999994, 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.889 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522471+0000", 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4900000000000002e-07 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523191+0000", 2024-09-17T16:42:54.890 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000720417 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523614+0000", 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042271600000000001 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523627+0000", 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2809999999999999e-05 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.891 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523707+0000", 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0507999999999996e-05 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523719+0000", 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1701e-05 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531573+0000", 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078534969999999992 2024-09-17T16:42:54.892 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531607+0000", 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4412999999999997e-05 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:287 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~704512] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.456509+0000", 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.422994651, 2024-09-17T16:42:54.893 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016711638000000001, 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 287 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.456509+0000", 2024-09-17T16:42:54.894 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.456509+0000", 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.456512+0000", 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0029999999999999e-06 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.895 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457447+0000", 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093523599999999999 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457467+0000", 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9839000000000001e-05 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457480+0000", 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2914e-05 2024-09-17T16:42:54.896 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457574+0000", 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3932999999999997e-05 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.457581+0000", 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2969999999999998e-06 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.897 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459762+0000", 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002180885 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459841+0000", 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9351999999999995e-05 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.461106+0000", 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001264598 2024-09-17T16:42:54.898 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471826+0000", 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010720517000000001 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.473100+0000", 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012736150000000001 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.899 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.473220+0000", 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000120449 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:288 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.420992394999999, 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018124781, 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.900 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 288 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.901 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458512+0000", 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.201e-06 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459021+0000", 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000508696 2024-09-17T16:42:54.902 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459036+0000", 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4946000000000001e-05 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459044+0000", 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2330000000000006e-06 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.903 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459105+0000", 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2959999999999998e-06 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467231+0000", 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081265810000000008 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.904 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467343+0000", 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111366 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.468193+0000", 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085095400000000001 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472015+0000", 2024-09-17T16:42:54.905 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038219119999999998 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476572+0000", 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045570619999999997 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476636+0000", 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3184999999999999e-05 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.906 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:289 3.es0 3:7af0cf48:::smithi18337221-43:head [setxattr _header (56) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.420439612999999, 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017770232, 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.907 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 289 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.908 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5199999999999996e-07 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459069+0000", 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459077+0000", 2024-09-17T16:42:54.909 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459083+0000", 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3620000000000002e-06 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459130+0000", 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6876000000000003e-05 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.910 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459135+0000", 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3340000000000003e-06 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471144+0000", 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012009117999999999 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471236+0000", 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2281999999999995e-05 2024-09-17T16:42:54.911 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471658+0000", 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042205299999999998 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472216+0000", 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055826699999999999 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.912 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476768+0000", 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045520710000000004 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476834+0000", 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5445999999999996e-05 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.913 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:290 3.es0 3:7af0cf48:::smithi18337221-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.420404481999999, 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021360535999999999, 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 290 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.914 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:42:54.915 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459107+0000", 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2930000000000003e-06 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459115+0000", 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.208e-06 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.916 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459121+0000", 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459161+0000", 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9637e-05 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459168+0000", 2024-09-17T16:42:54.917 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3000000000000004e-06 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471869+0000", 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012700899 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471947+0000", 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8330000000000004e-05 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.918 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477178+0000", 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052311160000000001 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477230+0000", 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1366999999999998e-05 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.480459+0000", 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032295029999999999 2024-09-17T16:42:54.919 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:353 3.es0 3:7af0cf48:::smithi18337221-43:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.399990898999999, 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030354281, 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.920 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 353 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:42:54.921 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479514+0000", 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4649999999999999e-06 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479520+0000", 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7910000000000001e-06 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.922 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479530+0000", 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0753e-05 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479539+0000", 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9260000000000006e-06 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479975+0000", 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043575500000000002 2024-09-17T16:42:54.923 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480105+0000", 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013020600000000001 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490191+0000", 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010086247 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.924 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501337+0000", 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011145446999999999 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509772+0000", 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084349049999999995 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509867+0000", 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4785999999999997e-05 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.925 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:354 3.es0 3:7af0cf48:::smithi18337221-43:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.479564+0000", 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.399939238999998, 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015648311000000002, 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.926 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 354 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479564+0000", 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.927 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479564+0000", 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479565+0000", 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.928 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479569+0000", 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3059999999999999e-06 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479576+0000", 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1040000000000001e-06 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.929 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479582+0000", 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9410000000000004e-06 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480367+0000", 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078543099999999995 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:54.930 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480400+0000", 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2573999999999997e-05 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495023+0000", 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01462282 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.931 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495108+0000", 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5399e-05 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495212+0000", 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010411700000000001 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.932 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:355 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~475136] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.391402830000001, 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022143336, 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 355 2024-09-17T16:42:54.933 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.934 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488102+0000", 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1119999999999999e-06 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488993+0000", 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089148899999999998 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489004+0000", 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1270000000000001e-05 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.935 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489012+0000", 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9729999999999997e-06 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495281+0000", 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062688559999999997 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495381+0000", 2024-09-17T16:42:54.936 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100233 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496316+0000", 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093481 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509884+0000", 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013567932 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.937 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510170+0000", 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028624299999999999 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510244+0000", 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3417999999999994e-05 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.938 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWriteReply(3.es0 55/34 ECSubWriteReply(tid=128, last_complete=55'26, committed=1, applied=1))", 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.389909455000002, 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011740087999999999, 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:54.939 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489594+0000", 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2099999999999996e-07 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.940 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489599+0000", 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.707e-06 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489608+0000", 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2499999999999995e-06 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489619+0000", 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0648e-05 2024-09-17T16:42:54.941 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501127+0000", 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011507455999999999 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501334+0000", 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020730600000000001 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.942 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:356 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~622592] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.387352604, 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01999051, 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 356 2024-09-17T16:42:54.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492153+0000", 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.911e-06 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492881+0000", 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072854300000000001 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492894+0000", 2024-09-17T16:42:54.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2435e-05 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492902+0000", 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-06 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501528+0000", 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086269080000000008 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501643+0000", 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011425399999999999 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502627+0000", 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098378000000000007 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509887+0000", 2024-09-17T16:42:54.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072604310000000003 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512095+0000", 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022076079999999998 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512141+0000", 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6570999999999998e-05 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.948 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:357 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~147456] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.386585546999999, 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020343033999999999, 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.949 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 357 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8800000000000002e-07 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492986+0000", 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7827e-05 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492993+0000", 2024-09-17T16:42:54.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8709999999999999e-06 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492999+0000", 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6500000000000001e-06 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507458+0000", 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014459013999999999 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507570+0000", 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011199199999999999 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.508224+0000", 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065380799999999997 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510045+0000", 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018218609999999999 2024-09-17T16:42:54.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513184+0000", 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031387979999999999 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513261+0000", 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:358 3.es0 3:7858efeb:::smithi18337221-46:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.386494824, 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020438640000000001, 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 358 2024-09-17T16:42:54.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493009+0000", 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493012+0000", 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8150000000000002e-06 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493019+0000", 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3490000000000003e-06 2024-09-17T16:42:54.957 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493024+0000", 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8690000000000003e-06 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510349+0000", 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017324736 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510406+0000", 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7293000000000002e-05 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510704+0000", 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000298101 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511712+0000", 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001008227 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513366+0000", 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016533780000000001 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513447+0000", 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1322000000000005e-05 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.960 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:359 3.es0 3:7858efeb:::smithi18337221-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.386471445000002, 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021336417999999999, 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.961 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 359 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:54.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.34e-07 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493036+0000", 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8010000000000001e-06 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493041+0000", 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9910000000000002e-06 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493046+0000", 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8409999999999999e-06 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511258+0000", 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018211793 2024-09-17T16:42:54.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511428+0000", 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017049099999999999 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513824+0000", 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002395533 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513926+0000", 2024-09-17T16:42:54.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102079 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.514368+0000", 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044245500000000002 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:360 3.es0 3:78f58299:::smithi18337221-26:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.966 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.386450434, 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028558304999999999, 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 360 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.967 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.46e-07 2024-09-17T16:42:54.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493057+0000", 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9099999999999998e-06 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493062+0000", 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5530000000000003e-06 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493066+0000", 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5719999999999996e-06 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511762+0000", 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018695494 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511863+0000", 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010166999999999999 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.515440+0000", 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003576419 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517437+0000", 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019973209999999998 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521513+0000", 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040760140000000002 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521611+0000", 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7905999999999994e-05 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:361 3.es0 3:78f58299:::smithi18337221-26:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.386430327999999, 2024-09-17T16:42:54.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024151737999999999, 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 361 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:54.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7899999999999999e-07 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493075+0000", 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1090000000000001e-06 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493082+0000", 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4749999999999998e-06 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493087+0000", 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6829999999999999e-06 2024-09-17T16:42:54.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512244+0000", 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019157789000000001 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512274+0000", 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258e-05 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517080+0000", 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004806495 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517152+0000", 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1958000000000005e-05 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517225+0000", 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2491999999999996e-05 2024-09-17T16:42:54.977 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s5 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518276+0000", 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.361226741999999, 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011617036000000001, 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518276+0000", 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518276+0000", 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518277+0000", 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9700000000000002e-07 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518602+0000", 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00032559100000000002 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518624+0000", 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.145e-05 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518631+0000", 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9789999999999996e-06 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518690+0000", 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8721000000000002e-05 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518696+0000", 2024-09-17T16:42:54.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7259999999999996e-06 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529854+0000", 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011157976999999999 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529894+0000", 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9195e-05 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.982 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:598 3.es0 3:7af0cf48:::smithi18337221-43:head [read 0~278528,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:48.454796+0000", 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.4247071230000001, 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085716560000000004, 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.983 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 598 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454796+0000", 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454796+0000", 2024-09-17T16:42:54.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454798+0000", 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1390000000000002e-06 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454810+0000", 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1425e-05 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454829+0000", 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9635000000000001e-05 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454838+0000", 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9209999999999998e-06 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454916+0000", 2024-09-17T16:42:54.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7373000000000006e-05 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454924+0000", 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1689999999999992e-06 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.460976+0000", 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060526310000000002 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.461040+0000", 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3571000000000005e-05 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.463368+0000", 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002327792 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.988 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:599 3.es0 3:7af0cf48:::smithi18337221-43:head [read 0~278528,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:48.454859+0000", 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.4246441839999999, 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088937510000000001, 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 599 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.989 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454859+0000", 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454859+0000", 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454859+0000", 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2399999999999999e-07 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454862+0000", 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.198e-06 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454866+0000", 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9019999999999998e-06 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454870+0000", 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1590000000000002e-06 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454975+0000", 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000105005 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454978+0000", 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8160000000000004e-06 2024-09-17T16:42:54.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.461688+0000", 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0067099259999999997 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.461746+0000", 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7354e-05 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.463753+0000", 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002007067 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:600 3.es0 3:7af0cf48:::smithi18337221-43:head [read 66758~211770,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:48.454898+0000", 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.4246052919999999, 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095815929999999994, 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:54.994 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 600 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454898+0000", 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454898+0000", 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454898+0000", 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5400000000000002e-07 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454901+0000", 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.649e-06 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454906+0000", 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6550000000000003e-06 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.454910+0000", 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.374e-06 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.455013+0000", 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000103328 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.455020+0000", 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.956e-06 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.461941+0000", 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006920781 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:42:54.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.461992+0000", 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0855e-05 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:48.464480+0000", 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0024876410000000001 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:54.999 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:55.001 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:42:55.002 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:54.999+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:55.102 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:55.100+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:55.144 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:55.144 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:55.145 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:55.153 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:42:55.203 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:55.201+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:55.255 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:55.255 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:55.255 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:55.263 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:42:55.304 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:55.302+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:55.367 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.871718213000001, 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089069189999999993, 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:42:55.368 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492597+0000", 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493106+0000", 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050891100000000002 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.369 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493115+0000", 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8079999999999999e-06 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493123+0000", 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8259999999999993e-06 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493203+0000", 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0124999999999996e-05 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.370 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493212+0000", 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8340000000000005e-06 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501463+0000", 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082505530000000007 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501503+0000", 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9965000000000001e-05 2024-09-17T16:42:55.371 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.852693733000002, 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016927722999999999, 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.372 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511621+0000", 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:42:55.373 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512062+0000", 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044157400000000002 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512083+0000", 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1058999999999999e-05 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512094+0000", 2024-09-17T16:42:55.374 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0559e-05 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512185+0000", 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1187999999999995e-05 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512196+0000", 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0668e-05 2024-09-17T16:42:55.375 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528498+0000", 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016302408000000001 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528548+0000", 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9808000000000002e-05 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.376 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 46/34 ECSubWrite(tid=63, reqid=client.4553.0:266, at_version=46'34, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.847158043, 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011393616000000001, 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.377 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517157+0000", 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4600000000000003e-07 2024-09-17T16:42:55.378 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517245+0000", 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8442999999999993e-05 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517258+0000", 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2527999999999999e-05 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.379 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517267+0000", 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1230000000000006e-06 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517400+0000", 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133015 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517409+0000", 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8980000000000002e-06 2024-09-17T16:42:55.380 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528486+0000", 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011077053999999999 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528550+0000", 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3708999999999996e-05 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.381 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.844186403000002, 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093715889999999996, 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:42:55.382 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520129+0000", 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0759999999999999e-06 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.383 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520297+0000", 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168049 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520317+0000", 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.384 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520326+0000", 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6269999999999995e-06 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520397+0000", 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0418000000000002e-05 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520406+0000", 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.385 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529445+0000", 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090386540000000001 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529499+0000", 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4462000000000001e-05 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.386 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=129, reqid=client.4553.0:353, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.874120919999999, 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01022205, 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.387 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490194+0000", 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2330000000000001e-06 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.388 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490267+0000", 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2262999999999996e-05 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490279+0000", 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2446000000000001e-05 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490288+0000", 2024-09-17T16:42:55.389 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490363+0000", 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4833999999999995e-05 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490371+0000", 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2640000000000008e-06 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.390 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500387+0000", 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010015242000000001 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500415+0000", 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8512000000000001e-05 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.391 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.871092571999998, 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085314020000000004, 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:42:55.392 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493222+0000", 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8100000000000001e-07 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.393 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493630+0000", 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040793900000000001 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493642+0000", 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1742e-05 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493655+0000", 2024-09-17T16:42:55.394 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3207000000000001e-05 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493706+0000", 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0887999999999998e-05 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493716+0000", 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3810000000000005e-06 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.395 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501720+0000", 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080045050000000003 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501753+0000", 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2858999999999998e-05 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:42:55.396 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 26.868007922, 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010886477, 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.397 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496307+0000", 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496400+0000", 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2985000000000005e-05 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.398 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496415+0000", 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4674e-05 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496423+0000", 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2870000000000004e-06 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496478+0000", 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5077999999999997e-05 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.399 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496488+0000", 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507159+0000", 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010670513 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.400 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507193+0000", 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3884999999999998e-05 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.862161229000002, 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010661874999999999, 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.401 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.402 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502154+0000", 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1999999999999998e-07 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502368+0000", 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000213904 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502383+0000", 2024-09-17T16:42:55.403 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5447999999999998e-05 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502395+0000", 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1589e-05 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502457+0000", 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2644000000000005e-05 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502467+0000", 2024-09-17T16:42:55.404 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0206e-05 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512759+0000", 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010291234999999999 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.405 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512815+0000", 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6029000000000002e-05 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=129, reqid=osd.5.0:129, at_version=60'87, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.504191+0000", 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.860122867000001, 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0078014139999999996, 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.406 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504191+0000", 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504191+0000", 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.407 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504192+0000", 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504263+0000", 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0758000000000003e-05 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.408 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504310+0000", 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7613e-05 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504335+0000", 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4133000000000001e-05 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504947+0000", 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061235 2024-09-17T16:42:55.409 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504958+0000", 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0821e-05 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.511913+0000", 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069554090000000001 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.410 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.511993+0000", 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9499999999999994e-05 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 60/34 ECSubWrite(tid=130, reqid=osd.5.0:130, at_version=60'19, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.859905044000001, 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082366980000000006, 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.411 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504410+0000", 2024-09-17T16:42:55.412 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-06 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504450+0000", 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9808999999999998e-05 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504480+0000", 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0326000000000001e-05 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.413 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504488+0000", 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.96e-06 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504566+0000", 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8146999999999996e-05 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504577+0000", 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0468999999999999e-05 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.414 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512615+0000", 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080376030000000008 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512646+0000", 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1198000000000002e-05 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.415 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=131, reqid=osd.5.0:131, at_version=60'89, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.859112012000001, 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012770672, 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:42:55.416 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505203+0000", 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.017e-06 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.417 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505226+0000", 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3224e-05 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505239+0000", 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505248+0000", 2024-09-17T16:42:55.418 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9549999999999998e-06 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507065+0000", 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018174560000000001 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507074+0000", 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6589999999999996e-06 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.419 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517937+0000", 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010863268000000001 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517973+0000", 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5349000000000003e-05 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.420 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 60/34 ECSubWrite(tid=132, reqid=client.4553.0:429, at_version=60'21, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.858210960000001, 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084385769999999992, 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:42:55.421 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506104+0000", 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.422 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506142+0000", 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7592000000000002e-05 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506156+0000", 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4269e-05 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506165+0000", 2024-09-17T16:42:55.423 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9279999999999999e-06 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506988+0000", 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00082270100000000001 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506998+0000", 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0118e-05 2024-09-17T16:42:55.424 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514501+0000", 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075035309999999999 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514542+0000", 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0519999999999998e-05 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.425 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.426 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.426 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 60/34 ECSubWrite(tid=145, reqid=osd.4.0:145, at_version=60'33, trim_to=0'0, roll_forward_to=59'31))", 2024-09-17T16:42:55.542 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:42:55.542 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.854965674999999, 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083206809999999999, 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:42:55.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509349+0000", 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6100000000000002e-07 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509370+0000", 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1115e-05 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509381+0000", 2024-09-17T16:42:55.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1476e-05 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509390+0000", 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509447+0000", 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6520000000000001e-05 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509457+0000", 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6889999999999999e-06 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517639+0000", 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081822079999999998 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517669+0000", 2024-09-17T16:42:55.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0182999999999999e-05 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 60/34 ECSubWrite(tid=145, reqid=osd.2.0:145, at_version=60'47, trim_to=0'0, roll_forward_to=59'43))", 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.850568535000001, 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01010516, 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.548 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.92e-07 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513775+0000", 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8588000000000001e-05 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513792+0000", 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6854000000000002e-05 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513806+0000", 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4683e-05 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515751+0000", 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001944814 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515778+0000", 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7189999999999999e-05 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523825+0000", 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080462659999999998 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523851+0000", 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5973e-05 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=138, reqid=client.4553.0:432, at_version=60'91, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.850326129999999, 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099123409999999999, 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513989+0000", 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.82e-07 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514171+0000", 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018223600000000001 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514183+0000", 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2313999999999999e-05 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514192+0000", 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1849999999999993e-06 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514282+0000", 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0068999999999994e-05 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514294+0000", 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.203e-05 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523860+0000", 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095660139999999994 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523900+0000", 2024-09-17T16:42:55.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9910999999999998e-05 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.908615158, 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015125326, 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.558 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.04e-07 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456064+0000", 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036538299999999999 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456076+0000", 2024-09-17T16:42:55.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456084+0000", 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7139999999999999e-06 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456157+0000", 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3034000000000006e-05 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456168+0000", 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0789e-05 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470774+0000", 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014606060000000001 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470824+0000", 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9960000000000003e-05 2024-09-17T16:42:55.562 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 65/34 ECSubWrite(tid=70, reqid=client.4553.0:502, at_version=65'28, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.463074+0000", 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.901239612000001, 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083920739999999994, 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463074+0000", 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463074+0000", 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463075+0000", 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8299999999999995e-07 2024-09-17T16:42:55.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463734+0000", 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065840400000000002 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463759+0000", 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4941999999999999e-05 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463769+0000", 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0117e-05 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463832+0000", 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2834000000000002e-05 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463844+0000", 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2327000000000001e-05 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.471441+0000", 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075973450000000001 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.471467+0000", 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5222e-05 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9146284369999993, 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012786751000000001, 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449687+0000", 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-06 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449814+0000", 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012759199999999999 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449828+0000", 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3566e-05 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449852+0000", 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4219999999999999e-05 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449921+0000", 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8886000000000004e-05 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449931+0000", 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7529999999999996e-06 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462433+0000", 2024-09-17T16:42:55.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012502233 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462472+0000", 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9307000000000002e-05 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:42:55.572 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9064274060000006, 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010065104, 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457888+0000", 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.04e-06 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458356+0000", 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046822600000000003 2024-09-17T16:42:55.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458387+0000", 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892999999999997e-05 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458397+0000", 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9660000000000008e-06 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458678+0000", 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028162199999999998 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458693+0000", 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4616e-05 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.467925+0000", 2024-09-17T16:42:55.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092320630000000004 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.467952+0000", 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6678000000000001e-05 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.462718+0000", 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.9015964079999996, 2024-09-17T16:42:55.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081524890000000006, 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462718+0000", 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462718+0000", 2024-09-17T16:42:55.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462718+0000", 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9599999999999998e-07 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.463050+0000", 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033110399999999998 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.463061+0000", 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1532000000000001e-05 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.463068+0000", 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8689999999999998e-06 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.463115+0000", 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6962000000000002e-05 2024-09-17T16:42:55.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.463122+0000", 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0210000000000002e-06 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.470826+0000", 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0077045660000000004 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.470870+0000", 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3639e-05 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.582 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:55.583 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15] out_osds: [13] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:42:55.583 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:42:55.583 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-17T16:42:55.583 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T16:42:55.583 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T16:42:55.583 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-17T16:42:55.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:42:55.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:42:55.588 INFO:tasks.rados.rados.0.smithi183.stdout:252: done (2 left) 2024-09-17T16:42:55.588 INFO:tasks.rados.rados.0.smithi183.stdout:253: done (1 left) 2024-09-17T16:42:55.588 INFO:tasks.rados.rados.0.smithi183.stdout:255: done (0 left) 2024-09-17T16:42:55.588 INFO:tasks.rados.rados.0.smithi183.stdout:256: read oid 13 snap -1 2024-09-17T16:42:55.588 INFO:tasks.rados.rados.0.smithi183.stdout:256: expect (ObjNum 84 snap 13 seq_num 84) 2024-09-17T16:42:55.588 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 8 current snap is 26 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:257: seq_num 104 ranges {491520=589824,1081344=540672,1622016=622592} 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:257: writing smithi18337221-8 from 491520 to 1081344 tid 1 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:257: writing smithi18337221-8 from 1081344 to 1622016 tid 2 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:257: writing smithi18337221-8 from 1622016 to 2244608 tid 3 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:258: delete oid 4 current snap is 26 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:258: done (2 left) 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:259: read oid 6 snap -1 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:259: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 43 current snap is 26 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:260: seq_num 106 ranges {278528=622592,901120=442368,1343488=524288,1867776=196608} 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:260: writing smithi18337221-43 from 278528 to 901120 tid 1 2024-09-17T16:42:55.589 INFO:tasks.rados.rados.0.smithi183.stdout:260: writing smithi18337221-43 from 901120 to 1343488 tid 2 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:260: writing smithi18337221-43 from 1343488 to 1867776 tid 3 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:260: writing smithi18337221-43 from 1867776 to 2064384 tid 4 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:261: read oid 47 snap 25 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:261: expect deleted 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:262: read oid 5 snap -1 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:262: expect (ObjNum 4 snap 0 seq_num 4) 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:263: delete oid 36 current snap is 26 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:259: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:256: expect (ObjNum 84 snap 13 seq_num 84) 2024-09-17T16:42:55.590 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.591 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.591 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:55.581+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:55.592 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.648 INFO:tasks.rados.rados.0.smithi183.stdout:257: finishing write tid 1 to smithi18337221-8 2024-09-17T16:42:55.648 INFO:tasks.rados.rados.0.smithi183.stdout:257: finishing write tid 2 to smithi18337221-8 2024-09-17T16:42:55.648 INFO:tasks.rados.rados.0.smithi183.stdout:257: finishing write tid 3 to smithi18337221-8 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:257: finishing write tid 4 to smithi18337221-8 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:256: done (6 left) 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:259: done (5 left) 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:261: done (4 left) 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:263: done (3 left) 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 6 current snap is 26 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:262: expect (ObjNum 4 snap 0 seq_num 4) 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 56966 2024-09-17T16:42:55.649 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:55.650 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 59415 2024-09-17T16:42:55.650 INFO:tasks.rados.rados.0.smithi183.stdout:257: finishing write tid 5 to smithi18337221-8 2024-09-17T16:42:55.650 INFO:tasks.rados.rados.0.smithi183.stdout:257: oid 8 updating version 0 to 165 2024-09-17T16:42:55.650 INFO:tasks.rados.rados.0.smithi183.stdout:257: oid 8 updating version 165 to 168 2024-09-17T16:42:55.650 INFO:tasks.rados.rados.0.smithi183.stdout:257: oid 8 version 168 is already newer than 166 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:257: oid 8 version 168 is already newer than 167 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 8 v 168 (ObjNum 104 snap 26 seq_num 104) dirty exists 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:257: left oid 8 (ObjNum 104 snap 26 seq_num 104) 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: finishing write tid 1 to smithi18337221-43 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: finishing write tid 2 to smithi18337221-43 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: finishing write tid 3 to smithi18337221-43 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: finishing write tid 4 to smithi18337221-43 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: finishing write tid 5 to smithi18337221-43 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: finishing write tid 6 to smithi18337221-43 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: oid 43 updating version 0 to 82 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: oid 43 updating version 82 to 83 2024-09-17T16:42:55.651 INFO:tasks.rados.rados.0.smithi183.stdout:260: oid 43 updating version 83 to 85 2024-09-17T16:42:55.652 INFO:tasks.rados.rados.0.smithi183.stdout:260: oid 43 version 85 is already newer than 81 2024-09-17T16:42:55.652 INFO:tasks.rados.rados.0.smithi183.stdout:260: oid 43 version 85 is already newer than 84 2024-09-17T16:42:55.652 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 85 (ObjNum 106 snap 26 seq_num 106) dirty exists 2024-09-17T16:42:55.652 INFO:tasks.rados.rados.0.smithi183.stdout:260: left oid 43 (ObjNum 106 snap 26 seq_num 106) 2024-09-17T16:42:55.652 INFO:tasks.rados.rados.0.smithi183.stdout:264: seq_num 108 ranges {98304=655360,753664=606208,1359872=475136,1835008=81920} 2024-09-17T16:42:55.654 INFO:tasks.rados.rados.0.smithi183.stdout:264: writing smithi18337221-6 from 98304 to 753664 tid 1 2024-09-17T16:42:55.657 INFO:tasks.rados.rados.0.smithi183.stdout:264: writing smithi18337221-6 from 753664 to 1359872 tid 2 2024-09-17T16:42:55.660 INFO:tasks.rados.rados.0.smithi183.stdout:264: writing smithi18337221-6 from 1359872 to 1835008 tid 3 2024-09-17T16:42:55.661 INFO:tasks.rados.rados.0.smithi183.stdout:264: writing smithi18337221-6 from 1835008 to 1916928 tid 4 2024-09-17T16:42:55.661 INFO:tasks.rados.rados.0.smithi183.stdout:257: done (3 left) 2024-09-17T16:42:55.661 INFO:tasks.rados.rados.0.smithi183.stdout:260: done (2 left) 2024-09-17T16:42:55.661 INFO:tasks.rados.rados.0.smithi183.stdout:262: done (1 left) 2024-09-17T16:42:55.661 INFO:tasks.rados.rados.0.smithi183.stdout:265: delete oid 41 current snap is 26 2024-09-17T16:42:55.663 INFO:tasks.rados.rados.0.smithi183.stdout:265: done (1 left) 2024-09-17T16:42:55.664 INFO:tasks.rados.rados.0.smithi183.stdout:266: setattr oid 37 current snap is 26 2024-09-17T16:42:55.666 INFO:tasks.rados.rados.0.smithi183.stdout:267: read oid 38 snap -1 2024-09-17T16:42:55.666 INFO:tasks.rados.rados.0.smithi183.stdout:267: expect (ObjNum 100 snap 21 seq_num 100) 2024-09-17T16:42:55.666 INFO:tasks.rados.rados.0.smithi183.stdout:268: read oid 50 snap -1 2024-09-17T16:42:55.666 INFO:tasks.rados.rados.0.smithi183.stdout:268: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-17T16:42:55.666 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 29 current snap is 26 2024-09-17T16:42:55.666 INFO:tasks.rados.rados.0.smithi183.stdout:269: seq_num 110 ranges {1490944=688128,2179072=507904,2686976=655360} 2024-09-17T16:42:55.678 INFO:tasks.rados.rados.0.smithi183.stdout:269: writing smithi18337221-29 from 1490944 to 2179072 tid 1 2024-09-17T16:42:55.681 INFO:tasks.rados.rados.0.smithi183.stdout:269: writing smithi18337221-29 from 2179072 to 2686976 tid 2 2024-09-17T16:42:55.684 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:55.682+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:55.685 INFO:tasks.rados.rados.0.smithi183.stdout:269: writing smithi18337221-29 from 2686976 to 3342336 tid 3 2024-09-17T16:42:55.685 INFO:tasks.rados.rados.0.smithi183.stdout:270: snap_remove snap 22 2024-09-17T16:42:55.703 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:42:55.703 INFO:teuthology.orchestra.run.smithi183.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T16:42:55.704 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:42:55.704 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:55.704 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:55.704 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:42:55.704 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:55.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:42:55.785 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:55.783+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:55.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:42:55.856 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:42:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:42:55.856 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:42:55.856 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:55.864 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:42:55.886 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:55.884+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:55.915 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:55.915 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:55.933 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:55.933 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:55.950 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:55.950 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:55.967 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:55.968 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:55.969 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.454874717000003, 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013863510000000001, 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513354+0000", 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001750883 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513367+0000", 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3108999999999999e-05 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513376+0000", 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8969999999999997e-06 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513451+0000", 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513461+0000", 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0023999999999999e-05 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.973 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525431+0000", 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011969377 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525467+0000", 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5988000000000002e-05 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:42:55.974 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.443808066000003, 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089774009999999994, 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.522670+0000", 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2899999999999999e-07 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523392+0000", 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072203800000000004 2024-09-17T16:42:55.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523434+0000", 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1365000000000001e-05 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523451+0000", 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7119e-05 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.977 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523565+0000", 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011433 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523577+0000", 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1697e-05 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531599+0000", 2024-09-17T16:42:55.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080225629999999999 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.531647+0000", 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7960000000000002e-05 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=93, reqid=osd.5.0:93, at_version=55'60, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.481477503000001, 2024-09-17T16:42:55.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099079770000000001, 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:42:55.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485001+0000", 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485013+0000", 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2393e-05 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485021+0000", 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9230000000000002e-06 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485026+0000", 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0980000000000001e-06 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485078+0000", 2024-09-17T16:42:55.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1650999999999997e-05 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485087+0000", 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9039999999999998e-06 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494869+0000", 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097825159999999998 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494908+0000", 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.909e-05 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 55/34 ECSubWrite(tid=60, reqid=osd.14.0:60, at_version=55'29, trim_to=0'0, roll_forward_to=53'25))", 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.481001405000001, 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091203440000000007, 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.985 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-17T16:42:55.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485497+0000", 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0041e-05 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485509+0000", 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1668000000000001e-05 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485517+0000", 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.841e-06 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485572+0000", 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325999999999998e-05 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485582+0000", 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105000000000001e-05 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494561+0000", 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089786810000000005 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494597+0000", 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6019000000000002e-05 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.479901323, 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018742894999999999, 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486599+0000", 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1361000000000001e-05 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486608+0000", 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486616+0000", 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.537e-06 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486743+0000", 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127188 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486748+0000", 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4489999999999998e-06 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505277+0000", 2024-09-17T16:42:55.994 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018528340000000001 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505320+0000", 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2834999999999999e-05 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=122, reqid=osd.4.0:119, at_version=0'0, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.479392790999999, 2024-09-17T16:42:55.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013009134, 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:42:55.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487086+0000", 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5099999999999999e-07 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487097+0000", 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:55.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487113+0000", 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5336e-05 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487121+0000", 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487184+0000", 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3207999999999995e-05 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487195+0000", 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1467999999999999e-05 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499908+0000", 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012713089 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:55.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500094+0000", 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000185847 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 55/34 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=55'24, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.476567664000001, 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010075503, 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1899999999999999e-07 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489931+0000", 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-05 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489946+0000", 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5729000000000001e-05 2024-09-17T16:42:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489954+0000", 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2549999999999997e-06 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490014+0000", 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9242e-05 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490024+0000", 2024-09-17T16:42:56.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.004e-05 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499913+0000", 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098893910000000008 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499986+0000", 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2607000000000005e-05 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.004 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.473124844000001, 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090505629999999993, 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:56.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493354+0000", 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7199999999999997e-07 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493765+0000", 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041148500000000001 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493776+0000", 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1021e-05 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493784+0000", 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5569999999999998e-06 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5838999999999999e-05 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493836+0000", 2024-09-17T16:42:56.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.993e-06 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502370+0000", 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085342400000000002 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502404+0000", 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3556000000000002e-05 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.467594632000001, 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011728341, 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498884+0000", 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6400000000000001e-07 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499236+0000", 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035160500000000001 2024-09-17T16:42:56.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499249+0000", 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3454e-05 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499256+0000", 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.905e-06 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499318+0000", 2024-09-17T16:42:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2067000000000001e-05 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499329+0000", 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1131000000000001e-05 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510579+0000", 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011250135 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510612+0000", 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2280000000000003e-05 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.6s6 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 27.359580734000001, 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089676530000000008, 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.015 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606897+0000", 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.016 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.606898+0000", 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9699999999999995e-07 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607272+0000", 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037431900000000002 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607286+0000", 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.328e-05 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607294+0000", 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8179999999999993e-06 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607356+0000", 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1290000000000004e-05 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.607366+0000", 2024-09-17T16:42:56.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8949999999999993e-06 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.615839+0000", 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084733959999999994 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.615865+0000", 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5857999999999999e-05 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.019 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 22.447905675000001, 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011339162, 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:56.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518573+0000", 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518909+0000", 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033576100000000001 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518925+0000", 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5661000000000001e-05 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518933+0000", 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4209999999999995e-06 2024-09-17T16:42:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519013+0000", 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0346000000000006e-05 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519023+0000", 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0212e-05 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529853+0000", 2024-09-17T16:42:56.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010829221 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529911+0000", 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8709999999999999e-05 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:42:56.024 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.515258573000001, 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016876885000000001, 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:42:56.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451220+0000", 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7499999999999999e-07 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451677+0000", 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045773500000000002 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451691+0000", 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3679000000000001e-05 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451699+0000", 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0679999999999997e-06 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451773+0000", 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4064000000000001e-05 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451783+0000", 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9259999999999995e-06 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468036+0000", 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016253360000000001 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468096+0000", 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9877999999999998e-05 2024-09-17T16:42:56.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 62/34 ECSubWrite(tid=178, reqid=osd.4.0:178, at_version=62'26, trim_to=0'0, roll_forward_to=61'24))", 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.512066105999999, 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092270379999999999, 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-07 2024-09-17T16:42:56.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454436+0000", 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3799999999999999e-05 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454444+0000", 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3459999999999994e-06 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454449+0000", 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0939999999999998e-06 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454497+0000", 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7525000000000003e-05 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454502+0000", 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4299999999999997e-06 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463615+0000", 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091123920000000004 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463639+0000", 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4141000000000001e-05 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 62/34 ECSubWrite(tid=177, reqid=osd.4.0:177, at_version=62'41, trim_to=0'0, roll_forward_to=61'39))", 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.511951142000001, 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090665380000000007, 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7e-07 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454543+0000", 2024-09-17T16:42:56.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5809999999999999e-05 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454551+0000", 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7559999999999999e-06 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454557+0000", 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4609999999999996e-06 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454604+0000", 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6408e-05 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454611+0000", 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4379999999999998e-06 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463555+0000", 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089443869999999998 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463593+0000", 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7907999999999997e-05 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 62/34 ECSubWrite(tid=179, reqid=osd.4.0:179, at_version=62'43, trim_to=0'0, roll_forward_to=61'39))", 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.455721+0000", 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.510756689000001, 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0088753960000000007, 2024-09-17T16:42:56.038 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455721+0000", 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455721+0000", 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455722+0000", 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3e-07 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455741+0000", 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9023999999999999e-05 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455753+0000", 2024-09-17T16:42:56.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1765e-05 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455761+0000", 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2609999999999993e-06 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455817+0000", 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.605e-05 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.455825+0000", 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3990000000000004e-06 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464562+0000", 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087364279999999992 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464597+0000", 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4739000000000001e-05 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.042 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=161, reqid=osd.5.0:161, at_version=62'106, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.508969236999999, 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010613879999999999, 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.37e-07 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457532+0000", 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2344000000000002e-05 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457542+0000", 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0698e-05 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457550+0000", 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9289999999999998e-06 2024-09-17T16:42:56.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458149+0000", 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059811399999999996 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458387+0000", 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238247 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468103+0000", 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097161869999999994 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468123+0000", 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9624e-05 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=62'108, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:42:56.047 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.507493053000001, 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091647150000000004, 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458986+0000", 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7800000000000001e-07 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459007+0000", 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1586999999999998e-05 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459017+0000", 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0142999999999999e-05 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459026+0000", 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8200000000000003e-06 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459585+0000", 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055877100000000001 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459593+0000", 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1519999999999992e-06 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468128+0000", 2024-09-17T16:42:56.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085349339999999992 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468150+0000", 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1630000000000001e-05 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:42:56.052 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.506167843, 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094236489999999992, 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:42:56.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460311+0000", 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5899999999999996e-07 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460665+0000", 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035421500000000001 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460681+0000", 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5739e-05 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460689+0000", 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3340000000000002e-06 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464005+0000", 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033161390000000001 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464015+0000", 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0242e-05 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469702+0000", 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056865780000000003 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469734+0000", 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1843e-05 2024-09-17T16:42:56.056 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 17.512184482999999, 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013750108, 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454294+0000", 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6e-07 2024-09-17T16:42:56.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081548199999999997 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455123+0000", 2024-09-17T16:42:56.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4392999999999999e-05 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455130+0000", 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6800000000000004e-06 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455201+0000", 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1088999999999996e-05 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455214+0000", 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2923e-05 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.467980+0000", 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012766136000000001 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.468044+0000", 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3244999999999995e-05 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.061 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.50477258899999999, 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098962259999999993, 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:42:56.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461706+0000", 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7800000000000001e-07 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.063 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461987+0000", 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028039999999999999 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461998+0000", 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1080000000000001e-05 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462005+0000", 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3799999999999996e-06 2024-09-17T16:42:56.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462079+0000", 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3937999999999996e-05 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462087+0000", 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1270000000000003e-06 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.471578+0000", 2024-09-17T16:42:56.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094905340000000001 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.471602+0000", 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3989e-05 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:42:56.066 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:42:56.067 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:56.068 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:56.068 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:56.069 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:56.069 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:42:56.069 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:56.065+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:56.070 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:56.070 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:56.070 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:56.071 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:56.071 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:56.071 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:56.071 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:56.072 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:56.085 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:56.085 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:56.102 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:56.118 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:56.136 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:56.153 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:56.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:56.151+0000 7f4633fff640 0 -- 172.21.15.60:0/2104648189 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f4634223f30 msgr2=0x7f4634226320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:56.169 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:56.167+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:56.212 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.212 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.221 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:42:56.270 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:56.268+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:56.323 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.324 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.332 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:42:56.371 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:56.369+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:56.372 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:56.372 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:56.435 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.435 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.444 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:42:56.471 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:56.470+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:56.490 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:42:56.494 INFO:tasks.rados.rados.0.smithi183.stdout:270: done (5 left) 2024-09-17T16:42:56.494 INFO:tasks.rados.rados.0.smithi183.stdout:271: read oid 22 snap -1 2024-09-17T16:42:56.494 INFO:tasks.rados.rados.0.smithi183.stdout:271: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:42:56.494 INFO:tasks.rados.rados.0.smithi183.stdout:272: rollback oid 48 current snap is 26 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 48 to 25 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 55 (ObjNum 71 snap 10 seq_num 71) dirty exists 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:264: finishing write tid 1 to smithi18337221-6 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:264: finishing write tid 2 to smithi18337221-6 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:264: finishing write tid 3 to smithi18337221-6 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:264: finishing write tid 4 to smithi18337221-6 2024-09-17T16:42:56.495 INFO:tasks.rados.rados.0.smithi183.stdout:268: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: finishing write tid 5 to smithi18337221-6 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: finishing write tid 6 to smithi18337221-6 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: oid 6 updating version 0 to 24 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: oid 6 updating version 24 to 25 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: oid 6 version 25 is already newer than 23 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: oid 6 version 25 is already newer than 21 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: oid 6 version 25 is already newer than 22 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 6 v 25 (ObjNum 108 snap 26 seq_num 108) dirty exists 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:264: left oid 6 (ObjNum 108 snap 26 seq_num 108) 2024-09-17T16:42:56.496 INFO:tasks.rados.rados.0.smithi183.stdout:267: expect (ObjNum 100 snap 21 seq_num 100) 2024-09-17T16:42:56.497 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:56.517 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:56.536 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: finishing write tid 1 to smithi18337221-29 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: finishing write tid 2 to smithi18337221-29 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: finishing write tid 3 to smithi18337221-29 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: finishing write tid 4 to smithi18337221-29 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: finishing write tid 5 to smithi18337221-29 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: oid 29 updating version 0 to 42 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: oid 29 version 42 is already newer than 41 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: oid 29 updating version 42 to 43 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:269: oid 29 updating version 43 to 44 2024-09-17T16:42:56.555 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 29 v 44 (ObjNum 110 snap 26 seq_num 110) dirty exists 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:269: left oid 29 (ObjNum 110 snap 26 seq_num 110) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:264: done (6 left) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:266: done (5 left) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:267: done (4 left) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:268: done (3 left) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:269: done (2 left) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:273: rmattr oid 16 current snap is 26 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:273: done (2 left) 2024-09-17T16:42:56.556 INFO:tasks.rados.rados.0.smithi183.stdout:274: snap_remove snap 13 2024-09-17T16:42:56.557 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.557 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.566 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:42:56.573 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:56.571+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:56.668 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.668 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.673 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:56.671+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:56.676 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:42:56.774 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:56.772+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:56.779 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.779 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.788 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:42:56.876 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:56.874+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:56.932 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:56.932 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:56.941 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:42:56.977 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:56.975+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:57.043 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.043 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.051 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:42:57.080 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:57.077+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:57.154 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.155 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.163 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:42:57.179 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:57.177+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:57.264 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.264 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.273 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:42:57.280 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:57.278+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:57.377 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.377 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.381 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:57.379+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:57.386 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:42:57.482 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:57.480+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:57.507 INFO:tasks.rados.rados.0.smithi183.stdout:274: done (2 left) 2024-09-17T16:42:57.508 INFO:tasks.rados.rados.0.smithi183.stdout:275: snap_remove snap 18 2024-09-17T16:42:57.539 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.539 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.548 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:42:57.582 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:42:57.581+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:42:57.651 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.651 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.659 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:42:57.683 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:57.681+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:57.761 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.762 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.770 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:42:57.814 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:42:57.812+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:42:57.872 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:57.873 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:57.881 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:42:57.885 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:57.883+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:57.985 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:42:57.984+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:42:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:58.002 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:58.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:42:58.086 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:58.084+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:58.119 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:58.119 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:58.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:42:58.187 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:58.185+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:58.235 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:58.235 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:58.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:42:58.288 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:42:58.286+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:42:58.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:42:58.388 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:58.387+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:58.390 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:58.390 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:58.399 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:42:58.489 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:42:58.487+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:42:58.507 INFO:tasks.rados.rados.0.smithi183.stdout:275: done (2 left) 2024-09-17T16:42:58.507 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 47 current snap is 26 2024-09-17T16:42:58.507 INFO:tasks.rados.rados.0.smithi183.stdout:271: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:42:58.507 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:58.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:42:58.512 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 224999 2024-09-17T16:42:58.512 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:58.516 INFO:tasks.rados.rados.0.smithi183.stdout:272: finishing rollback tid 0 to smithi18337221-48 2024-09-17T16:42:58.516 INFO:tasks.rados.rados.0.smithi183.stdout:272: finishing rollback tid 1 to smithi18337221-48 2024-09-17T16:42:58.516 INFO:tasks.rados.rados.0.smithi183.stdout:272: finishing rollback tid 2 to smithi18337221-48 2024-09-17T16:42:58.516 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 48 v 29 (ObjNum 98 snap 20 seq_num 98) dirty exists 2024-09-17T16:42:58.516 INFO:tasks.rados.rados.0.smithi183.stdout:276: seq_num 111 ranges {0=704512,704512=655360,1359872=507904} 2024-09-17T16:42:58.520 INFO:tasks.rados.rados.0.smithi183.stdout:276: writing smithi18337221-47 from 0 to 704512 tid 1 2024-09-17T16:42:58.521 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:42:58.521 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:42:58.524 INFO:tasks.rados.rados.0.smithi183.stdout:276: writing smithi18337221-47 from 704512 to 1359872 tid 2 2024-09-17T16:42:58.527 INFO:tasks.rados.rados.0.smithi183.stdout:276: writing smithi18337221-47 from 1359872 to 1867776 tid 3 2024-09-17T16:42:58.527 INFO:tasks.rados.rados.0.smithi183.stdout:271: done (2 left) 2024-09-17T16:42:58.527 INFO:tasks.rados.rados.0.smithi183.stdout:272: done (1 left) 2024-09-17T16:42:58.528 INFO:tasks.rados.rados.0.smithi183.stdout:277: read oid 25 snap -1 2024-09-17T16:42:58.528 INFO:tasks.rados.rados.0.smithi183.stdout:277: expect (ObjNum 72 snap 10 seq_num 72) 2024-09-17T16:42:58.528 INFO:tasks.rados.rados.0.smithi183.stdout:278: snap_create 2024-09-17T16:42:58.546 INFO:tasks.rados.rados.0.smithi183.stdout:277: expect (ObjNum 72 snap 10 seq_num 72) 2024-09-17T16:42:58.549 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 638442 2024-09-17T16:42:58.560 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:42:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:42:58.573 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:42:58.576 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 606760 2024-09-17T16:42:58.578 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:42:58.578 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:42:58.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:42:58.596 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:42:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:42:58.596 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:42:58.594+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:42:58.599 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:42:58.615 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:42:58.615 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: finishing write tid 1 to smithi18337221-47 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: finishing write tid 2 to smithi18337221-47 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: finishing write tid 3 to smithi18337221-47 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: finishing write tid 4 to smithi18337221-47 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: finishing write tid 5 to smithi18337221-47 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: oid 47 updating version 0 to 116 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: oid 47 version 116 is already newer than 115 2024-09-17T16:42:58.630 INFO:tasks.rados.rados.0.smithi183.stdout:276: oid 47 version 116 is already newer than 114 2024-09-17T16:42:58.631 INFO:tasks.rados.rados.0.smithi183.stdout:276: oid 47 updating version 116 to 117 2024-09-17T16:42:58.631 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 47 v 117 (ObjNum 111 snap 26 seq_num 111) dirty exists 2024-09-17T16:42:58.631 INFO:tasks.rados.rados.0.smithi183.stdout:276: left oid 47 (ObjNum 111 snap 26 seq_num 111) 2024-09-17T16:42:58.633 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:42:58.633 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:42:58.652 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:42:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:42:58.669 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:42:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:42:58.686 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:42:58.686 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:42:58.690 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:58.688+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:42:58.704 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:42:58.712 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.233040977000002, 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.713 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.231108224000003, 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.230681232999999, 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.230647769000001, 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.230601462999999, 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.230541610000003, 2024-09-17T16:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.5.23:2 3.bs0 3:d08ffbb6:::smithi18337221-30:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.225271169000003, 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025206989999999999, 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483332+0000", 2024-09-17T16:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9630000000000001e-06 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483339+0000", 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483351+0000", 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483359+0000", 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506020+0000", 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022660777 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506121+0000", 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010158999999999999 2024-09-17T16:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508537+0000", 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002415848 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWriteReply(3.bs0 40/34 ECSubWriteReply(tid=61, last_complete=40'15, committed=1, applied=1))", 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.220611001999998, 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016316462, 2024-09-17T16:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487990+0000", 2024-09-17T16:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487992+0000", 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1400000000000001e-06 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.487999+0000", 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1459999999999999e-06 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488012+0000", 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3499000000000001e-05 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488021+0000", 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6519999999999995e-06 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504215+0000", 2024-09-17T16:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016193754000000001 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504307+0000", 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2270999999999998e-05 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:213 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.217941457000002, 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017648329000000001, 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 213 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490660+0000", 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490661+0000", 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3099999999999997e-07 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490665+0000", 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1010000000000002e-06 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490675+0000", 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0467e-05 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490681+0000", 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8939999999999998e-06 2024-09-17T16:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492163+0000", 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001481794 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492244+0000", 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0897999999999997e-05 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508308+0000", 2024-09-17T16:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016064544 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:295 3.bs0 3:d855b096:::smithi18337221-24:head [copy-from ver 7] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 35.243308583999998, 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016204202000000001, 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 295 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465293+0000", 2024-09-17T16:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465294+0000", 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.451e-06 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465300+0000", 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6659999999999996e-06 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465314+0000", 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4443e-05 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465322+0000", 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.52e-06 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465665+0000", 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00034335499999999999 2024-09-17T16:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.465770+0000", 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104732 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.473519+0000", 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077493609999999997 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.479834+0000", 2024-09-17T16:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063149369999999996 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481444+0000", 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0016096330000000001 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.481497+0000", 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3103999999999998e-05 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:351 3.7s0 3:e31d051c:::smithi18337221-15:head [copy-from ver 8] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.229123678000001, 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023291879000000001, 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 351 2024-09-17T16:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479479+0000", 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.671e-06 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479487+0000", 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.763e-06 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479504+0000", 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6891000000000001e-05 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479513+0000", 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0690000000000008e-06 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479567+0000", 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3599e-05 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479657+0000", 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9906000000000003e-05 2024-09-17T16:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.493160+0000", 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013503724999999999 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.500514+0000", 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073532679999999996 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502657+0000", 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002143407 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502770+0000", 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011258 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:352 3.7s0 3:e31d051c:::smithi18337221-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.229069228, 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020327753, 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 352 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479533+0000", 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3200000000000005e-07 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479537+0000", 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.403e-06 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479548+0000", 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0444e-05 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479555+0000", 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0559999999999999e-06 2024-09-17T16:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479795+0000", 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023998499999999999 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479858+0000", 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2729000000000002e-05 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499619+0000", 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019761535 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499738+0000", 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118867 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499860+0000", 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012210199999999999 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:433 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~622592] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.193081592999999, 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019410863, 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.783 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 433 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515522+0000", 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8160000000000001e-06 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516965+0000", 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014435629999999999 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516981+0000", 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5681000000000001e-05 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516991+0000", 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8239999999999995e-06 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517069+0000", 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8172999999999998e-05 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517201+0000", 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000132101 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518296+0000", 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010954490000000001 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532966+0000", 2024-09-17T16:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014669013 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534841+0000", 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018757509999999999 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534931+0000", 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9492000000000003e-05 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:434 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~475136] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.1896892, 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017119724999999999, 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 434 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518912+0000", 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518914+0000", 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519590+0000", 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067595600000000002 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519604+0000", 2024-09-17T16:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4391e-05 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.519613+0000", 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4179999999999997e-06 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.524975+0000", 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053627240000000001 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.525091+0000", 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115345 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.526035+0000", 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00094401900000000004 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533023+0000", 2024-09-17T16:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069880280000000003 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.535985+0000", 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0029618489999999999 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.536032+0000", 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7379000000000002e-05 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:435 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~294912] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.187739535999999, 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018146874, 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 435 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520863+0000", 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4050000000000001e-06 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521158+0000", 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029489000000000002 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521173+0000", 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5228000000000001e-05 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521184+0000", 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0332999999999999e-05 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529465+0000", 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082808810000000004 2024-09-17T16:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529536+0000", 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.161e-05 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.530071+0000", 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053491699999999999 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533025+0000", 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002953401 2024-09-17T16:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.538970+0000", 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059453010000000001 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539009+0000", 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8908000000000001e-05 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:436 3.1s0 3:845a4d43:::smithi18337221-2:head [setxattr _header (56) in=7b] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.187403084, 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017989387999999999, 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 436 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521199+0000", 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9999999999999997e-07 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521213+0000", 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4215e-05 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521223+0000", 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9340000000000001e-06 2024-09-17T16:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521229+0000", 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0329999999999997e-06 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532021+0000", 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010791558 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532136+0000", 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115529 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532681+0000", 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054450799999999997 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533396+0000", 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071506499999999997 2024-09-17T16:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539125+0000", 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057293409999999998 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539188+0000", 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2504999999999999e-05 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:437 3.1s0 3:845a4d43:::smithi18337221-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.187362073999999, 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018905465, 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 437 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521240+0000", 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521242+0000", 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.43e-06 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521251+0000", 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4910000000000005e-06 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521256+0000", 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0629999999999996e-06 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533246+0000", 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011990466999999999 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533313+0000", 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7045999999999995e-05 2024-09-17T16:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539424+0000", 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061101920000000004 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539475+0000", 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1892999999999999e-05 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.540145+0000", 2024-09-17T16:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00066938200000000005 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:540 3.bs0 3:d08ffbb6:::smithi18337221-30:head [append 0~425984] snapc 14=[14,13,10,f] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.450934+0000", 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.257667198, 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017124098000000001, 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 540 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.450934+0000", 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.450934+0000", 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.450937+0000", 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9979999999999999e-06 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451410+0000", 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047251500000000001 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451436+0000", 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6353999999999999e-05 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451446+0000", 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.7710000000000001e-06 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451531+0000", 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5223999999999996e-05 2024-09-17T16:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.451541+0000", 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4150000000000005e-06 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.453780+0000", 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002238978 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.453901+0000", 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121626 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.454995+0000", 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010940640000000001 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467722+0000", 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012726922 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467987+0000", 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026504700000000003 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.468058+0000", 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1184000000000002e-05 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:543 3.bs0 3:d08ffbb6:::smithi18337221-30:head [setxattr _header (57) in=7b] snapc 14=[14,13,10,f] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.458073+0000", 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.250528536999999, 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017073801, 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 543 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458073+0000", 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458073+0000", 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458074+0000", 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458077+0000", 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6610000000000002e-06 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458086+0000", 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3960000000000006e-06 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458094+0000", 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7209999999999994e-06 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.471663+0000", 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013569505000000001 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.471718+0000", 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5074999999999997e-05 2024-09-17T16:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.472136+0000", 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041782700000000001 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.472701+0000", 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00056461 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475053+0000", 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002352392 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475147+0000", 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3756000000000002e-05 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:544 3.bs0 3:d08ffbb6:::smithi18337221-30:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.25049855, 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018041647000000001, 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 544 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458104+0000", 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8299999999999996e-07 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458106+0000", 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6139999999999999e-06 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458117+0000", 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0536e-05 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458122+0000", 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5099999999999998e-06 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.473227+0000", 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015105084 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.473280+0000", 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2886999999999997e-05 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475521+0000", 2024-09-17T16:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022407680000000002 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475616+0000", 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4841999999999998e-05 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.476145+0000", 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052872300000000004 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:58.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:42:58.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:42:58.832 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:42:58.832 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:42:58.833 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:42:58.833 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:42:58.833 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:42:58.833 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:42:58.834 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:42:58.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:42:58.771+0000 7fe2d89fb640 0 -- 172.21.15.60:0/872500673 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fe2d4221370 msgr2=0x7fe2d4223760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:42:58.834 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:42:58.829+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:42:58.932 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:42:58.930+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:42:58.979 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:58.979 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:58.979 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:58.979 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:58.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:42:58.992 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:42:58.993 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:42:59.009 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:42:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:42:59.033 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:42:59.032+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:42:59.100 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:59.100 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:59.100 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:59.100 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:59.100 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:59.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:42:59.134 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:42:59.132+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:42:59.217 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:59.217 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:59.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:59.217 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:59.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.217 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:178 3.4s0 3:216603c8:::smithi18337221-7:head [copy-from ver 2] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 46.753880336000002, 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0097627789999999992, 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 178 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460518+0000", 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460520+0000", 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3209999999999999e-06 2024-09-17T16:42:59.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460526+0000", 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4590000000000003e-06 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460539+0000", 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2634e-05 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460546+0000", 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0450000000000003e-06 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460588+0000", 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1984999999999999e-05 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.460652+0000", 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4475999999999997e-05 2024-09-17T16:42:59.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.466465+0000", 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0058132269999999998 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.469088+0000", 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026224709999999999 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470220+0000", 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001132248 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:12.470281+0000", 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0912999999999998e-05 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.223 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:199 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 764485~497083,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.736584481999998, 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010265850999999999, 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.224 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 199 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477814+0000", 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477816+0000", 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8530000000000001e-06 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477825+0000", 2024-09-17T16:42:59.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8850000000000005e-06 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477841+0000", 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6070999999999999e-05 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477851+0000", 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0261999999999999e-05 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477947+0000", 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5457000000000004e-05 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477956+0000", 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9639999999999992e-06 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480792+0000", 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028365840000000001 2024-09-17T16:42:59.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.480879+0000", 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7130000000000001e-05 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.488080+0000", 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0072006450000000003 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:200 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.736519229999999, 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011662507000000001, 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 200 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.230 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477880+0000", 2024-09-17T16:42:59.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8599999999999998e-07 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477886+0000", 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5740000000000001e-06 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477906+0000", 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9604000000000001e-05 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477914+0000", 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5859999999999999e-06 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478028+0000", 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011431500000000001 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478034+0000", 2024-09-17T16:42:59.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0530000000000003e-06 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481597+0000", 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035624699999999999 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481685+0000", 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8129999999999998e-05 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489542+0000", 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078571890000000005 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:201 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.736469565, 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013839093, 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 201 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477930+0000", 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:42:59.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1189999999999999e-06 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477949+0000", 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1701e-05 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477955+0000", 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6529999999999997e-06 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121858 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478083+0000", 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7150000000000003e-06 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482035+0000", 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039517290000000002 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482114+0000", 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9499000000000006e-05 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491768+0000", 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096540259999999996 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.721010681999999, 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096456860000000005, 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493388+0000", 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493389+0000", 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.057e-06 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495399+0000", 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002010529 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495410+0000", 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0983e-05 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495418+0000", 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0120000000000005e-06 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495585+0000", 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000166274 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495592+0000", 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5580000000000003e-06 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.502976+0000", 2024-09-17T16:42:59.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073836580000000004 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503034+0000", 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7615000000000003e-05 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 35.753262483, 2024-09-17T16:42:59.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010978876, 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461136+0000", 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462292+0000", 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001155611 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462308+0000", 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6039e-05 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462318+0000", 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3989999999999993e-06 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462380+0000", 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2589999999999995e-05 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462390+0000", 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0020999999999999e-05 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472076+0000", 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096855420000000001 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472115+0000", 2024-09-17T16:42:59.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9242999999999997e-05 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.718018258000001, 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013323026999999999, 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496381+0000", 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:42:59.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496856+0000", 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047436000000000001 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496867+0000", 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.165e-05 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496876+0000", 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8650000000000007e-06 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496951+0000", 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4673999999999997e-05 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496961+0000", 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.048e-05 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012637884 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509703+0000", 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104149 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.254 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.708616601999999, 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088565450000000004, 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505782+0000", 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505783+0000", 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2600000000000001e-07 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506045+0000", 2024-09-17T16:42:59.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026176500000000001 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506148+0000", 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000102982 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506157+0000", 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9840000000000007e-06 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506467+0000", 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00030994099999999999 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.506482+0000", 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5934999999999999e-05 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514604+0000", 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0081217470000000003 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514638+0000", 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4264999999999998e-05 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.721991265, 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095737730000000007, 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492407+0000", 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1600000000000001e-07 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493082+0000", 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067486599999999999 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493097+0000", 2024-09-17T16:42:59.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4405e-05 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493107+0000", 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0254999999999999e-05 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493184+0000", 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.661e-05 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493194+0000", 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0156000000000001e-05 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501938+0000", 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087447870000000004 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.501981+0000", 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2577999999999998e-05 2024-09-17T16:42:59.263 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.463747+0000", 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.75065133, 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095891359999999998, 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.264 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463747+0000", 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463747+0000", 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463748+0000", 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2200000000000004e-07 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463886+0000", 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013780800000000001 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463908+0000", 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2617e-05 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463917+0000", 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7509999999999997e-06 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463986+0000", 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9462999999999995e-05 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463997+0000", 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0638999999999999e-05 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.473297+0000", 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0092997510000000002 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.473336+0000", 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9484999999999999e-05 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.456871+0000", 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.7575275079999999, 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022293289000000001, 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.269 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456871+0000", 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456871+0000", 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456872+0000", 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5000000000000002e-07 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458675+0000", 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018029400000000001 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458693+0000", 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7893e-05 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.271 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458705+0000", 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.271e-05 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458806+0000", 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010067 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.272 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458819+0000", 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2772000000000001e-05 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479072+0000", 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020253589999999998 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479164+0000", 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2064000000000005e-05 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.461608+0000", 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.7527900459999999, 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017586277000000001, 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.274 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.461608+0000", 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.461608+0000", 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.461610+0000", 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5859999999999999e-06 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462598+0000", 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0009879890000000001 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462621+0000", 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3173999999999999e-05 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462633+0000", 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1326e-05 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.468213+0000", 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055799550000000002 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.468229+0000", 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6562000000000002e-05 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479174+0000", 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010945175 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479195+0000", 2024-09-17T16:42:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0509999999999998e-05 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.467746+0000", 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.7466525449999999, 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012456467000000001, 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.279 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467746+0000", 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467746+0000", 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467747+0000", 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1969999999999999e-06 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467983+0000", 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023602200000000001 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467999+0000", 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6121999999999999e-05 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.468011+0000", 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1399999999999999e-05 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472902+0000", 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0048909080000000002 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472912+0000", 2024-09-17T16:42:59.282 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0091e-05 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480018+0000", 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071064079999999998 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480202+0000", 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00018431900000000001 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.283 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=262, reqid=client.4553.0:636, at_version=82'168, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.470606+0000", 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.7437921439999999, 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010226103, 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.470606+0000", 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.470606+0000", 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.470608+0000", 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3859999999999999e-06 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.470630+0000", 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2243999999999999e-05 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.470650+0000", 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0020000000000001e-05 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.470681+0000", 2024-09-17T16:42:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0651999999999997e-05 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479242+0000", 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085617220000000008 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479253+0000", 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0492999999999999e-05 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480761+0000", 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015084230000000001 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480833+0000", 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1162999999999996e-05 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.288 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 82/77 ECSubWrite(tid=181, reqid=client.4553.0:642, at_version=82'81, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.472888+0000", 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.7415110010000001, 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010808216000000001, 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472888+0000", 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472888+0000", 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472888+0000", 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3799999999999999e-07 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473438+0000", 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000549757 2024-09-17T16:42:59.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473452+0000", 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4133e-05 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473463+0000", 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1235e-05 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473525+0000", 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2062000000000003e-05 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473535+0000", 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5400000000000001e-06 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.483668+0000", 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01013328 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.483696+0000", 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7971e-05 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:669 3.as0 3:50831259:::smithi18337221-29:head [append 0~688128] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.677948+0000", 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.5364502189999998, 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01517751, 2024-09-17T16:42:59.293 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 669 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.677948+0000", 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.677948+0000", 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.677949+0000", 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1310000000000001e-06 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.295 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678731+0000", 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078166399999999995 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678743+0000", 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1916000000000001e-05 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678748+0000", 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4539999999999998e-06 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678804+0000", 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5757999999999997e-05 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678873+0000", 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9177000000000005e-05 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.679683+0000", 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00080923099999999999 2024-09-17T16:42:59.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.687830+0000", 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0081469899999999998 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693051+0000", 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052210939999999999 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693126+0000", 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5094999999999998e-05 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:670 3.as0 3:50831259:::smithi18337221-29:head [append 0~507904] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.680616+0000", 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.533782661, 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013565578999999999, 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.299 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 670 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.680616+0000", 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.300 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.680616+0000", 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.680617+0000", 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6130000000000001e-06 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.681206+0000", 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058880499999999997 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.681223+0000", 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6773e-05 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.681232+0000", 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6710000000000005e-06 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684019+0000", 2024-09-17T16:42:59.302 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00278678 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684102+0000", 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3871999999999999e-05 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684877+0000", 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00077472000000000001 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693144+0000", 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082665640000000006 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.694145+0000", 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010013909999999999 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.694181+0000", 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390000000000002e-05 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.304 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:671 3.as0 3:50831259:::smithi18337221-29:head [append 0~655360] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.684203+0000", 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.5301957580000001, 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010104353999999999, 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.305 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 671 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684203+0000", 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684203+0000", 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.306 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684204+0000", 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7700000000000004e-07 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684919+0000", 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071581599999999998 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684930+0000", 2024-09-17T16:42:59.307 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0383e-05 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684936+0000", 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5320000000000003e-06 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.688051+0000", 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031145140000000001 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.688116+0000", 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5351999999999994e-05 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.688667+0000", 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00055110900000000004 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693219+0000", 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0045514029999999999 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.694269+0000", 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010500100000000001 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.694307+0000", 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8457999999999997e-05 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:672 3.as0 3:50831259:::smithi18337221-29:head [setxattr _header (57) in=7b] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.5294517810000001, 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012184228, 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 672 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.311 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0900000000000001e-07 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684949+0000", 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1220000000000002e-06 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684955+0000", 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2739999999999998e-06 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684958+0000", 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0630000000000002e-06 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.692428+0000", 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074701359999999996 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.692487+0000", 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9407999999999998e-05 2024-09-17T16:42:59.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.692763+0000", 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000275412 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693220+0000", 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045707300000000001 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:42:59.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697075+0000", 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038546700000000001 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697131+0000", 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6461e-05 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:673 3.as0 3:50831259:::smithi18337221-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:42:59.316 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 3.5294363469999999, 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013116195000000001, 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 673 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.317 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.53e-07 2024-09-17T16:42:59.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684964+0000", 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.361e-06 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684967+0000", 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6669999999999998e-06 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684970+0000", 2024-09-17T16:42:59.319 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6809999999999998e-06 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693421+0000", 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084511389999999999 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693467+0000", 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6022000000000001e-05 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697450+0000", 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039822379999999999 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697515+0000", 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5032999999999999e-05 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.698078+0000", 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00056380099999999995 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.321 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.322 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.322 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:59.323 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:42:59.324 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:42:59.321+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:42:59.424 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:59.423+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:59.430 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:59.431 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:59.431 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:42:59.431 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:59.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:42:59.509 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:42:59.516 INFO:tasks.rados.rados.0.smithi183.stdout:276: done (2 left) 2024-09-17T16:42:59.516 INFO:tasks.rados.rados.0.smithi183.stdout:277: done (1 left) 2024-09-17T16:42:59.516 INFO:tasks.rados.rados.0.smithi183.stdout:278: done (0 left) 2024-09-17T16:42:59.516 INFO:tasks.rados.rados.0.smithi183.stdout:279: copy_from oid 43 from oid 39 current snap is 27 2024-09-17T16:42:59.516 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 4 current snap is 27 2024-09-17T16:42:59.516 INFO:tasks.rados.rados.0.smithi183.stdout:280: seq_num 112 ranges {0=720896,720896=802816,1523712=360448} 2024-09-17T16:42:59.520 INFO:tasks.rados.rados.0.smithi183.stdout:280: writing smithi18337221-4 from 0 to 720896 tid 1 2024-09-17T16:42:59.525 INFO:tasks.rados.rados.0.smithi183.stdout:280: writing smithi18337221-4 from 720896 to 1523712 tid 2 2024-09-17T16:42:59.525 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:59.523+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:59.528 INFO:tasks.rados.rados.0.smithi183.stdout:280: writing smithi18337221-4 from 1523712 to 1884160 tid 3 2024-09-17T16:42:59.529 INFO:tasks.rados.rados.0.smithi183.stdout:281: snap_create 2024-09-17T16:42:59.532 INFO:tasks.rados.rados.0.smithi183.stdout:279: finishing copy_from racing read to smithi18337221-43 2024-09-17T16:42:59.534 INFO:tasks.rados.rados.0.smithi183.stdout:279: finishing copy_from to smithi18337221-43 2024-09-17T16:42:59.534 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 16 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-09-17T16:42:59.541 INFO:tasks.rados.rados.0.smithi183.stdout:280: finishing write tid 1 to smithi18337221-4 2024-09-17T16:42:59.541 INFO:tasks.rados.rados.0.smithi183.stdout:280: finishing write tid 2 to smithi18337221-4 2024-09-17T16:42:59.541 INFO:tasks.rados.rados.0.smithi183.stdout:280: finishing write tid 3 to smithi18337221-4 2024-09-17T16:42:59.542 INFO:tasks.rados.rados.0.smithi183.stdout:280: finishing write tid 4 to smithi18337221-4 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:280: finishing write tid 5 to smithi18337221-4 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:280: oid 4 updating version 0 to 69 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:280: oid 4 version 69 is already newer than 68 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:280: oid 4 updating version 69 to 71 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:280: oid 4 version 71 is already newer than 70 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 4 v 71 (ObjNum 112 snap 27 seq_num 112) dirty exists 2024-09-17T16:42:59.543 INFO:tasks.rados.rados.0.smithi183.stdout:280: left oid 4 (ObjNum 112 snap 27 seq_num 112) 2024-09-17T16:42:59.555 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:42:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:42:59.556 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:42:59.556 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:59.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:42:59.626 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:42:59.625+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:42:59.714 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 46.229729759999998, 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011223067999999999, 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.715 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.716 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499999999999999e-07 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482482+0000", 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014705100000000001 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482496+0000", 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4164e-05 2024-09-17T16:42:59.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482513+0000", 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6529e-05 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482631+0000", 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011836999999999999 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.718 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482642+0000", 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0895e-05 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493489+0000", 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010846876 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.719 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493558+0000", 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8827999999999999e-05 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 46.217242493999997, 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082916329999999996, 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494822+0000", 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.494823+0000", 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.201e-06 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495212+0000", 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038936199999999998 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495232+0000", 2024-09-17T16:42:59.722 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9830000000000002e-05 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495243+0000", 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0589e-05 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495340+0000", 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6824999999999995e-05 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.723 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.495350+0000", 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0778000000000001e-05 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503052+0000", 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077014559999999998 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.503113+0000", 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1592000000000003e-05 2024-09-17T16:42:59.724 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.250503164999998, 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010954281999999999, 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461562+0000", 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3300000000000002e-07 2024-09-17T16:42:59.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462055+0000", 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00049369500000000005 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462066+0000", 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1012000000000001e-05 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462074+0000", 2024-09-17T16:42:59.727 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1790000000000008e-06 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462143+0000", 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8353000000000001e-05 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462154+0000", 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0773e-05 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.728 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472429+0000", 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010275876999999999 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472515+0000", 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5859999999999994e-05 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:42:59.729 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.214798125000002, 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012371190000000001, 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.730 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497267+0000", 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3900000000000004e-07 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497341+0000", 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4518999999999996e-05 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.731 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497362+0000", 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1165000000000001e-05 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497371+0000", 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.85e-06 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497442+0000", 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0967e-05 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.733 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.733 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497451+0000", 2024-09-17T16:42:59.733 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6989999999999992e-06 2024-09-17T16:42:59.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012148320000000001 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509637+0000", 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8031000000000002e-05 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.736 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.213002761999999, 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015236921, 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.737 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499063+0000", 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1850000000000001e-06 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499453+0000", 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039015399999999998 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499469+0000", 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6203000000000001e-05 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499478+0000", 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6039999999999993e-06 2024-09-17T16:42:59.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499561+0000", 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3509000000000003e-05 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499570+0000", 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1050000000000001e-06 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.740 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514274+0000", 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014703344 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514298+0000", 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4817e-05 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=131, reqid=client.4553.0:356, at_version=55'31, trim_to=0'0, roll_forward_to=55'26))", 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:59.741 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.209078305999999, 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082760230000000004, 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.742 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502986+0000", 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502987+0000", 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.035e-06 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503283+0000", 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029568200000000002 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.743 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503296+0000", 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3321e-05 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503305+0000", 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7620000000000001e-06 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.744 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503370+0000", 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5180999999999998e-05 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.503380+0000", 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0489000000000001e-05 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511230+0000", 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078494970000000004 2024-09-17T16:42:59.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.511262+0000", 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2055999999999999e-05 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:59.746 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.206822852999998, 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090908770000000007, 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.747 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505241+0000", 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505242+0000", 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4099999999999997e-07 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505687+0000", 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00044460700000000002 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.748 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505704+0000", 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7407000000000001e-05 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505714+0000", 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5829999999999996e-06 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505775+0000", 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1254999999999995e-05 2024-09-17T16:42:59.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.505785+0000", 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9559999999999992e-06 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514308+0000", 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085228439999999999 2024-09-17T16:42:59.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514332+0000", 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4383999999999999e-05 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.219477468000001, 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013544347999999999, 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3200000000000001e-07 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493013+0000", 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00042638399999999998 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493028+0000", 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4295e-05 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493038+0000", 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0543999999999999e-05 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.755 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493139+0000", 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100438 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493149+0000", 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0241000000000001e-05 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506098+0000", 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012948665 2024-09-17T16:42:59.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506131+0000", 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3549e-05 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=106, reqid=client.4553.0:401, at_version=56'11, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:42:59.757 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.213316390999999, 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074167790000000001, 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.758 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498748+0000", 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498749+0000", 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.142e-06 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498887+0000", 2024-09-17T16:42:59.759 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013788200000000001 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498910+0000", 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2765e-05 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.498921+0000", 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1112e-05 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.499464+0000", 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054371699999999999 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.499474+0000", 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8980000000000008e-06 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.761 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506141+0000", 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0066664640000000004 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506165+0000", 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3799e-05 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.762 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.260686219, 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0085986420000000001, 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.764 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.451378+0000", 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0499999999999999e-07 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452396+0000", 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00101738 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452411+0000", 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5406000000000001e-05 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452420+0000", 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.302e-06 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452496+0000", 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5372999999999998e-05 2024-09-17T16:42:59.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.452505+0000", 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5750000000000007e-06 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459945+0000", 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074392540000000002 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459977+0000", 2024-09-17T16:42:59.767 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2047e-05 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=62'108, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:59.768 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.253055591999999, 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088499939999999999, 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.769 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459009+0000", 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1500000000000004e-07 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459030+0000", 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0313999999999999e-05 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459043+0000", 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3010000000000001e-05 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459050+0000", 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7409999999999992e-06 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459111+0000", 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0671999999999998e-05 2024-09-17T16:42:59.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.459120+0000", 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467826+0000", 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087057220000000008 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.772 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.467859+0000", 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.2592000000000002e-05 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.251601769000001, 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010326251, 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.774 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460463+0000", 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1600000000000001e-07 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460617+0000", 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000153993 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460630+0000", 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2549e-05 2024-09-17T16:42:59.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460639+0000", 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0669999999999998e-06 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460779+0000", 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000140159 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.776 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460843+0000", 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4352999999999999e-05 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470758+0000", 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0099145610000000006 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.777 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470789+0000", 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0953e-05 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 71/34 ECSubWrite(tid=218, reqid=client.4553.0:541, at_version=71'87, trim_to=0'0, roll_forward_to=64'84))", 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.460249+0000", 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.25181482, 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076668889999999996, 2024-09-17T16:42:59.778 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460249+0000", 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460249+0000", 2024-09-17T16:42:59.779 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460250+0000", 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3200000000000004e-07 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460383+0000", 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000132898 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.780 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460396+0000", 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2729e-05 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460407+0000", 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1626e-05 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460474+0000", 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6323999999999997e-05 2024-09-17T16:42:59.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.460485+0000", 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0822000000000001e-05 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467873+0000", 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.007388459 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.467916+0000", 2024-09-17T16:42:59.782 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3299e-05 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.254088721, 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011234937, 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457976+0000", 2024-09-17T16:42:59.784 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4099999999999998e-07 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458102+0000", 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012563099999999999 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458116+0000", 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3919e-05 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.785 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458124+0000", 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8040000000000002e-06 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458188+0000", 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4793000000000001e-05 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458197+0000", 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9649999999999997e-06 2024-09-17T16:42:59.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.469156+0000", 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010959106999999999 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.469210+0000", 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3977000000000002e-05 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.248980939999999, 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095375779999999997, 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.788 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463084+0000", 2024-09-17T16:42:59.789 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5099999999999999e-07 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463284+0000", 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019973899999999999 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463300+0000", 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5948999999999999e-05 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.790 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463309+0000", 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6169999999999996e-06 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463477+0000", 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016754000000000001 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463487+0000", 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0301e-05 2024-09-17T16:42:59.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.472531+0000", 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090443920000000001 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.472621+0000", 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9388999999999994e-05 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.2550906900000003, 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019139819999999998, 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:42:59.793 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8000000000000001e-07 2024-09-17T16:42:59.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458736+0000", 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001762018 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458753+0000", 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7102999999999999e-05 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458764+0000", 2024-09-17T16:42:59.795 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1039000000000001e-05 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458889+0000", 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012515399999999999 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458909+0000", 2024-09-17T16:42:59.796 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9313e-05 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476059+0000", 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017150744999999998 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476113+0000", 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4067999999999998e-05 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462240+0000", 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.2498243540000002, 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013909334000000001, 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462240+0000", 2024-09-17T16:42:59.798 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462240+0000", 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462241+0000", 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.339e-06 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462395+0000", 2024-09-17T16:42:59.799 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015429300000000001 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462420+0000", 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4655999999999999e-05 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462438+0000", 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7635999999999999e-05 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.800 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466467+0000", 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040290999999999999 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466481+0000", 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3736e-05 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476122+0000", 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096414090000000001 2024-09-17T16:42:59.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476149+0000", 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7165000000000002e-05 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.466622+0000", 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.2454425420000002, 2024-09-17T16:42:59.802 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0099262970000000006, 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466622+0000", 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466622+0000", 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466623+0000", 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466833+0000", 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00020982299999999999 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.804 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466853+0000", 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0136000000000002e-05 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466863+0000", 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0369e-05 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.471546+0000", 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046829259999999996 2024-09-17T16:42:59.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.471555+0000", 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8769999999999999e-06 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476508+0000", 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049527670000000003 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476548+0000", 2024-09-17T16:42:59.806 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0089000000000002e-05 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 82/77 ECSubWrite(tid=181, reqid=client.4553.0:642, at_version=82'81, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.2389118630000002, 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010671649, 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.808 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4100000000000001e-07 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473602+0000", 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00044972499999999999 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473617+0000", 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5176e-05 2024-09-17T16:42:59.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473627+0000", 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4409999999999999e-06 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473713+0000", 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5990999999999997e-05 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.810 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473725+0000", 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2631e-05 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.483778+0000", 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010052306 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.811 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.483824+0000", 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6238e-05 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 82/77 ECSubWrite(tid=182, reqid=client.4553.0:643, at_version=82'82, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.480062+0000", 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.2320022540000002, 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0091530440000000008, 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:42:59.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480062+0000", 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480062+0000", 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:42:59.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480063+0000", 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.269e-06 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480229+0000", 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000165883 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.814 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480242+0000", 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3189e-05 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480251+0000", 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480388+0000", 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013673799999999999 2024-09-17T16:42:59.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480400+0000", 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1435e-05 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.489170+0000", 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0087701459999999995 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:42:59.816 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.489215+0000", 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5255e-05 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:42:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:42:59.819 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:42:59.819 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:42:59.817+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:42:59.919 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:42:59.917+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:42:59.933 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:42:59.933 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:42:59.933 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:42:59.933 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:42:59.942 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:43:00.019 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:00.018+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:00.044 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.044 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:00.044 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:00.044 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:00.044 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.053 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:43:00.120 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:00.118+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:00.156 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.672803143000003, 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057823329999999997, 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.157 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481062+0000", 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481063+0000", 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6600000000000002e-07 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481326+0000", 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00026390499999999999 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481342+0000", 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5136e-05 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481349+0000", 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8469999999999996e-06 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481426+0000", 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6297000000000005e-05 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.481435+0000", 2024-09-17T16:43:00.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0289999999999994e-06 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.486818+0000", 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053832089999999999 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.486844+0000", 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6444e-05 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.161 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.663232256999997, 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012796989999999999, 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3699999999999999e-07 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492041+0000", 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014080290000000001 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492061+0000", 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9678e-05 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492070+0000", 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4050000000000006e-06 2024-09-17T16:43:00.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492139+0000", 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8300000000000007e-05 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492148+0000", 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7049999999999994e-06 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503396+0000", 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011248081 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503430+0000", 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3555e-05 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:00.166 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.656098499000002, 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078697639999999996, 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8100000000000002e-07 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497784+0000", 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497795+0000", 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0983e-05 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497803+0000", 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2209999999999997e-06 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497860+0000", 2024-09-17T16:43:00.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6886999999999999e-05 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497870+0000", 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0091999999999999e-05 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505602+0000", 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077316379999999999 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505636+0000", 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4677e-05 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.654906513999997, 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069241900000000002, 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.171 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4700000000000001e-07 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499112+0000", 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015267500000000001 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499122+0000", 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0473e-05 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499130+0000", 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1799999999999999e-06 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499180+0000", 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0114999999999997e-05 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499186+0000", 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5169999999999996e-06 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505852+0000", 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066659800000000002 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505883+0000", 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:43:00.175 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.654192479999999, 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059870100000000001, 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:00.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499973+0000", 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029958099999999999 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499984+0000", 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.08e-05 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499992+0000", 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5210000000000002e-06 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500153+0000", 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016087299999999999 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500161+0000", 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1170000000000004e-06 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505641+0000", 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054796269999999999 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505660+0000", 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8989999999999999e-05 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.180 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.642475222000002, 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061959889999999998, 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9900000000000002e-07 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511532+0000", 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014124600000000001 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511545+0000", 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3609e-05 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511555+0000", 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8220000000000002e-06 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511630+0000", 2024-09-17T16:43:00.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4807000000000004e-05 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511649+0000", 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9434000000000001e-05 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517548+0000", 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058984140000000003 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517586+0000", 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8358000000000001e-05 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.680321616000001, 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061901810000000003, 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.185 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473545+0000", 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474135+0000", 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000589867 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474152+0000", 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6772000000000001e-05 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474160+0000", 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6670000000000002e-06 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474226+0000", 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5572000000000002e-05 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474235+0000", 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8529999999999998e-06 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479694+0000", 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054593849999999998 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479734+0000", 2024-09-17T16:43:00.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9449000000000001e-05 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=123, reqid=osd.4.0:123, at_version=55'41, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.666466106000001, 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058804240000000004, 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.190 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487400+0000", 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8199999999999998e-07 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487417+0000", 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6994999999999999e-05 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487428+0000", 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1534e-05 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487436+0000", 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7470000000000005e-06 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487487+0000", 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0637999999999999e-05 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487494+0000", 2024-09-17T16:43:00.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0199999999999997e-06 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493233+0000", 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057390399999999999 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493279+0000", 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6567999999999999e-05 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=134, reqid=client.4553.0:379, at_version=55'47, trim_to=0'0, roll_forward_to=55'43))", 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.632674418000001, 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058772110000000002, 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:43:00.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521192+0000", 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3699999999999999e-07 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521211+0000", 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8970999999999998e-05 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521224+0000", 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3029e-05 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521233+0000", 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3829999999999998e-06 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521288+0000", 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5379e-05 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521298+0000", 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.527031+0000", 2024-09-17T16:43:00.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057332720000000002 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.527068+0000", 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7110999999999998e-05 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 55/34 ECSubWrite(tid=39, reqid=client.4553.0:386, at_version=55'14, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:00.199 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.555879169000001, 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006518182, 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9999999999999999e-07 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598219+0000", 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023223800000000001 2024-09-17T16:43:00.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598246+0000", 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7399e-05 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598270+0000", 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4323000000000001e-05 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.202 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598348+0000", 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7309000000000001e-05 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598364+0000", 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6724000000000001e-05 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604459+0000", 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060950049999999997 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604504+0000", 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4883999999999999e-05 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 55/34 ECSubWrite(tid=40, reqid=client.4553.0:387, at_version=55'15, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.604990+0000", 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.548874968, 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058385690000000001, 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.204 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604990+0000", 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604990+0000", 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604991+0000", 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4099999999999997e-07 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605101+0000", 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000109597 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605117+0000", 2024-09-17T16:43:00.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5922000000000001e-05 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605126+0000", 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9649999999999997e-06 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605218+0000", 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2004999999999997e-05 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605228+0000", 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0108999999999999e-05 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610795+0000", 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055673820000000001 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610829+0000", 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3648e-05 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.208 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 61/34 ECSubWrite(tid=59, reqid=osd.13.0:56, at_version=0'0, trim_to=0'0, roll_forward_to=61'23))", 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.525238+0000", 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.628627333000001, 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055593480000000004, 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525238+0000", 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525238+0000", 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525239+0000", 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0729999999999999e-06 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525252+0000", 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3541e-05 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525270+0000", 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7892000000000001e-05 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525280+0000", 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8430000000000005e-06 2024-09-17T16:43:00.211 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525376+0000", 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5731999999999998e-05 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.525387+0000", 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0664e-05 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.212 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.530755+0000", 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053681559999999998 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.530797+0000", 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2447000000000002e-05 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 61/34 ECSubWrite(tid=169, reqid=osd.4.0:169, at_version=61'63, trim_to=0'0, roll_forward_to=60'61))", 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:43:00.213 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.625361138999999, 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051300629999999998, 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:43:00.214 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528504+0000", 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1500000000000001e-07 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528528+0000", 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3978999999999999e-05 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.215 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528542+0000", 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3879e-05 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528551+0000", 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2080000000000006e-06 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528629+0000", 2024-09-17T16:43:00.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7874999999999996e-05 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.528643+0000", 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3834e-05 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.533594+0000", 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049510919999999998 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.533634+0000", 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9981000000000002e-05 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 61/34 ECSubWrite(tid=170, reqid=osd.4.0:170, at_version=61'65, trim_to=0'0, roll_forward_to=60'61))", 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.624244851, 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068917400000000004, 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.218 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529621+0000", 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8400000000000004e-07 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529638+0000", 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7316000000000002e-05 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529650+0000", 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1790000000000001e-05 2024-09-17T16:43:00.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529656+0000", 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.801e-06 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529702+0000", 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6038999999999997e-05 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529709+0000", 2024-09-17T16:43:00.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4919999999999996e-06 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536483+0000", 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067733170000000001 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536512+0000", 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9300999999999999e-05 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.454090+0000", 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 21.699775470999999, 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057171139999999997, 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454090+0000", 2024-09-17T16:43:00.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454090+0000", 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454091+0000", 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7290000000000001e-06 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454337+0000", 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024560899999999999 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454371+0000", 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4428000000000003e-05 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454381+0000", 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5719999999999992e-06 2024-09-17T16:43:00.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454483+0000", 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010149699999999999 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454494+0000", 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1858999999999999e-05 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.459774+0000", 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052791169999999998 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.459807+0000", 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3303000000000003e-05 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 71/34 ECSubWrite(tid=218, reqid=client.4553.0:541, at_version=71'87, trim_to=0'0, roll_forward_to=64'84))", 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:44.460360+0000", 2024-09-17T16:43:00.227 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.693505, 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050576320000000003, 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460360+0000", 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460360+0000", 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460361+0000", 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8299999999999995e-07 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460637+0000", 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00027555899999999998 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460651+0000", 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4229e-05 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460658+0000", 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9970000000000001e-06 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460705+0000", 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7147000000000001e-05 2024-09-17T16:43:00.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.460713+0000", 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8010000000000004e-06 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.465387+0000", 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046737339999999997 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:44.465418+0000", 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1182000000000001e-05 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 82/77 ECSubWrite(tid=181, reqid=client.4553.0:642, at_version=82'81, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.472744+0000", 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6811215800000001, 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051628189999999999, 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.472744+0000", 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.472744+0000", 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.472744+0000", 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5199999999999998e-07 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.473032+0000", 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028804200000000002 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.473045+0000", 2024-09-17T16:43:00.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3019e-05 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.473052+0000", 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2300000000000002e-06 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.473121+0000", 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9251000000000005e-05 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.473129+0000", 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0709999999999997e-06 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.477869+0000", 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.004740223 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.477906+0000", 2024-09-17T16:43:00.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7630999999999999e-05 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 82/77 ECSubWrite(tid=182, reqid=client.4553.0:643, at_version=82'82, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.6741705040000001, 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073096100000000002, 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.237 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:00.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0299999999999998e-07 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479881+0000", 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018565199999999999 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479896+0000", 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5038999999999999e-05 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479905+0000", 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1940000000000004e-06 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479963+0000", 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7911000000000002e-05 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479974+0000", 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0271e-05 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.486966+0000", 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069925229999999996 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.487004+0000", 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8216999999999997e-05 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 82/77 ECSubWrite(tid=55, reqid=client.4553.0:669, at_version=82'41, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.679692+0000", 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.4741734769999999, 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053347050000000003, 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.679692+0000", 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.679692+0000", 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.679692+0000", 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3900000000000001e-07 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.680180+0000", 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048765499999999998 2024-09-17T16:43:00.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.680194+0000", 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4039000000000001e-05 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.680200+0000", 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3960000000000003e-06 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.680269+0000", 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9356000000000005e-05 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.680280+0000", 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0509999999999999e-05 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.684995+0000", 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047150630000000002 2024-09-17T16:43:00.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.685026+0000", 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1446999999999999e-05 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 86/77 ECSubWrite(tid=197, reqid=client.4553.0:692, at_version=86'97, trim_to=0'0, roll_forward_to=85'95))", 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:59.525492+0000", 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.62837326500000001, 2024-09-17T16:43:00.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057400230000000003, 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525492+0000", 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525492+0000", 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525492+0000", 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.73e-07 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525880+0000", 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038746100000000002 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525894+0000", 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.472e-05 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525905+0000", 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0301e-05 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525978+0000", 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3127999999999995e-05 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.525987+0000", 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2709999999999998e-06 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.531199+0000", 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052123739999999997 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:59.531232+0000", 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2595000000000002e-05 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.250 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.251 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.251 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.251 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.252 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:43:00.253 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:00.250+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:00.353 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:00.351+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:00.395 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:00.395 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:00.395 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.403 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:43:00.447 INFO:tasks.rados.rados.0.smithi183.stdout:279: done (2 left) 2024-09-17T16:43:00.447 INFO:tasks.rados.rados.0.smithi183.stdout:280: done (1 left) 2024-09-17T16:43:00.447 INFO:tasks.rados.rados.0.smithi183.stdout:281: done (0 left) 2024-09-17T16:43:00.447 INFO:tasks.rados.rados.0.smithi183.stdout:282: snap_create 2024-09-17T16:43:00.453 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:00.451+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:00.507 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:00.507 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:00.508 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:00.508 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.516 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:43:00.555 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:00.553+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:187 3.cs0 3:385cb74d:::smithi18337221-1:head [copy-from ver 8] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:00.621 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.140442034000003, 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.039364976000000003, 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 187 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.622 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477631+0000", 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-17T16:43:00.623 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477644+0000", 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2748999999999999e-05 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477673+0000", 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8603e-05 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.624 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477688+0000", 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5454000000000001e-05 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477843+0000", 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015473799999999999 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8953e-05 2024-09-17T16:43:00.625 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480146+0000", 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022843439999999998 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480220+0000", 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3986999999999995e-05 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.626 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510626+0000", 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030406048000000001 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515100+0000", 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044740450000000003 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516938+0000", 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001837736 2024-09-17T16:43:00.627 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516994+0000", 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6045000000000003e-05 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:188 3.cs0 3:385cb74d:::smithi18337221-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:43:00.628 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.140336062000003, 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.036238998000000001, 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 188 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.629 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477736+0000", 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.494e-06 2024-09-17T16:43:00.630 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477742+0000", 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8930000000000002e-06 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477763+0000", 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0942999999999999e-05 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.631 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477781+0000", 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7479999999999999e-05 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019260600000000001 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477980+0000", 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4829999999999996e-06 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.632 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480439+0000", 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024594259999999998 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480480+0000", 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0512000000000001e-05 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513848+0000", 2024-09-17T16:43:00.633 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033368666999999998 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513906+0000", 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513974+0000", 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8291000000000001e-05 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.634 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:191 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.140142363999999, 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020837920999999999, 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 191 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.635 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.636 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477932+0000", 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2389999999999998e-06 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477939+0000", 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8530000000000003e-06 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.637 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477944+0000", 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3279999999999999e-06 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478088+0000", 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014464 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478091+0000", 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6900000000000001e-06 2024-09-17T16:43:00.638 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482685+0000", 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045939370000000002 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482783+0000", 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8634000000000005e-05 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.639 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483160+0000", 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000376645 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.484086+0000", 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000926092 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498688+0000", 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014601930000000001 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.640 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498767+0000", 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8502000000000002e-05 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:192 3.cs0 3:3e21370b:::smithi18337221-11:head [copy-from ver 6] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.140108394999999, 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028471962999999999, 2024-09-17T16:43:00.641 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 192 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.642 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999999e-07 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477966+0000", 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0769999999999999e-06 2024-09-17T16:43:00.643 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5239999999999997e-06 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477976+0000", 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2399999999999999e-06 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.644 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478121+0000", 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145038 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478126+0000", 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4480000000000002e-06 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483386+0000", 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052599209999999999 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.645 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483472+0000", 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6159e-05 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492564+0000", 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090913120000000007 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.501360+0000", 2024-09-17T16:43:00.646 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008796313 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506376+0000", 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050161659999999999 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506435+0000", 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8354999999999999e-05 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.647 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:193 3.cs0 3:3e21370b:::smithi18337221-11:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.140089314999997, 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020602901, 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.648 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 193 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.649 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477983+0000", 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3909999999999999e-06 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477992+0000", 2024-09-17T16:43:00.650 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5669999999999995e-06 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477995+0000", 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9119999999999998e-06 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478149+0000", 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153695 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:00.651 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478153+0000", 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5990000000000004e-06 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483619+0000", 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054658809999999997 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483650+0000", 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1115999999999998e-05 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.652 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498397+0000", 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014746853000000001 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498485+0000", 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8203999999999998e-05 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9411000000000001e-05 2024-09-17T16:43:00.653 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:266 3.cs0 3:3f892186:::smithi18337221-33:head [create,setxattr Y`URWapPpbRbcVnVY`QSNsZaZVYgbfr]kcmrp_g\\ (35) in=40b,setxattr QSnNfhP`\\rbs^]tkaRf]mXj_]bm_arNTstOQjkpY (1332) in=40b,setxattr YOlbral_g[Tac`rkYhXkaidaYfloWs]f`[kfmoeq (1402) in=40b,setxattr O\\Up[arf_O^_OTehidgQm\\_dWqiOgZeddoq[Yeim (421) in=40b,setxattr OliOVUW (1227) in=7b,setxattr mRZhPnOqZXai[tb[_iYpr_fWU`VpVZePspesWXth (9612) in=40b,setxattr p`]Nq_ParoVlgZ_RfOmdYljgitUhq[nn^STkQnm\\ (489) in=40b,setxattr gac_OaSTa[cilYpd\\TYRomd[_[t]lkbeSfUstbbO (385) in=40b,setxattr [^knka[\\][o`oZ[XWVa\\nRZ_^]h[\\ZPq`fqVZUm` (13472) in=40b,setxattr paYr[ki]Uj^gZYZXoSk]OhhpsdnXbWSQNQUhgNgp (1649) in=40b,setxattr SXYNfcNts[adfhlcih^SbYXacRgpdjjt_UedQoso (1789) in=40b,setxattr SsZS^dPc\\fk]ZQjgZ[i]iageNpNcccY^_QpkmcZR (1121) in=40b,setxattr cbOj`RWijYOTWkn\\Sk\\N_a[otcWhlc_kPXhaQhtm (1402) in=40b,setxattr fddhrQT_f\\R (1227) in=11b,setxattr jffqjeh^Weeqcg^`^Wa]]on^og\\VRjnkZqT\\oRWq (243) in=40b,setxattr i[eniSaVsaY_koZilr\\[qpYgN_PenNUPlN\\hNr]Z (1929) in=40b,setxattr Sbtooedescb]TlUVZR^hh[icrap_aWR^_mTZalnt (1963) in=40b,setxattr iYtRdsiUT^YaZcYqmPkOTbnaa_c^ (1227) in=28b,setxattr ao`Z_^XlrOjfeg]XV`]_[il^OU]]def]hmcaTagQ (349) in=40b,setxattr gg]bVkQeTo]\\ji^ph[UbnhXh_aaWYaTU_mQp`lPf (3576) in=40b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.107465726000001, 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018237339000000002, 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.654 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 266 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.655 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510605+0000", 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510606+0000", 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5099999999999998e-07 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510781+0000", 2024-09-17T16:43:00.656 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000174525 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510796+0000", 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5435999999999999e-05 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510804+0000", 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3969999999999997e-06 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.657 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510859+0000", 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5102999999999997e-05 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510863+0000", 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3959999999999999e-06 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.516079+0000", 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052157760000000001 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.658 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.516181+0000", 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101841 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517216+0000", 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010352790000000001 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.518703+0000", 2024-09-17T16:43:00.659 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014866829999999999 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528773+0000", 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010070608999999999 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528843+0000", 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9443000000000006e-05 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.660 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:404 3.5s0 3:a48bc8c8:::smithi18337221-49:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e56)", 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.12320227, 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017980659999999999, 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 404 2024-09-17T16:43:00.661 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.662 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494869+0000", 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9400000000000001e-07 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494871+0000", 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5069999999999999e-06 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494876+0000", 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2689999999999999e-06 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.663 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.494879+0000", 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1499999999999999e-06 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506094+0000", 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011215163 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.506241+0000", 2024-09-17T16:43:00.664 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014708899999999999 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512022+0000", 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057804579999999996 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512109+0000", 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6910999999999995e-05 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.665 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.512849+0000", 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074081899999999998 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:426 3.cs0 3:3f892186:::smithi18337221-33:head [read 691106~996446,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.503877+0000", 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.114194458, 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017332423999999999, 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.666 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 426 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503877+0000", 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.667 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503877+0000", 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503878+0000", 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4139999999999999e-06 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503967+0000", 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9321999999999996e-05 2024-09-17T16:43:00.668 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503981+0000", 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3213999999999999e-05 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.503991+0000", 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0648999999999999e-05 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.669 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508412+0000", 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044207739999999997 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508512+0000", 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100159 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.521209+0000", 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012696892 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.670 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:427 3.cs0 3:3f892186:::smithi18337221-33:head [read 1683278~4274,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.114061378999999, 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017439217999999999, 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.671 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 427 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.672 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504010+0000", 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4199999999999996e-07 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504014+0000", 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7950000000000001e-06 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.673 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504022+0000", 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7729999999999999e-06 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504028+0000", 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0820000000000004e-06 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511835+0000", 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078073700000000001 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.674 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.511962+0000", 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126792 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.521449+0000", 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0094868639999999994 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.675 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:428 3.cs0 3:3f892186:::smithi18337221-33:head [read 0~1687552,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.114034694000001, 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019143165, 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 428 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.676 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504037+0000", 2024-09-17T16:43:00.677 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0500000000000004e-07 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504046+0000", 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6400000000000003e-06 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504053+0000", 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3730000000000004e-06 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.678 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504058+0000", 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2970000000000003e-06 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512478+0000", 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084197920000000006 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.679 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512531+0000", 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3173000000000001e-05 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.523180+0000", 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010648385 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:547 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~442368] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:00.680 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.446495+0000", 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.171575921000001, 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022970733, 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 547 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.681 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.446495+0000", 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.446495+0000", 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.446497+0000", 2024-09-17T16:43:00.682 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9759999999999998e-06 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.447838+0000", 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001341128 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.447853+0000", 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5031000000000001e-05 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.683 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.447862+0000", 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6389999999999998e-06 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.448065+0000", 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020313199999999999 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.684 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.448143+0000", 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7983000000000002e-05 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449404+0000", 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260703 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.461546+0000", 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012142457000000001 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.685 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469401+0000", 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078549090000000002 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469466+0000", 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4775000000000002e-05 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.686 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:548 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~540672] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.450979+0000", 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.167092199000001, 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019762076999999999, 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 548 2024-09-17T16:43:00.687 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450979+0000", 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450979+0000", 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.688 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450981+0000", 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0159999999999998e-06 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.452224+0000", 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00124329 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.452236+0000", 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.198e-05 2024-09-17T16:43:00.689 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.452244+0000", 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1100000000000003e-06 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.456000+0000", 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003756059 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.690 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.456104+0000", 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104002 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457099+0000", 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099512199999999998 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469478+0000", 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012378867999999999 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.691 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.470686+0000", 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012076789999999999 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.470741+0000", 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4951000000000003e-05 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.692 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:549 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~622592] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.454425+0000", 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.163645976, 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019199834999999998, 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-17T16:43:00.693 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454425+0000", 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454425+0000", 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.694 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454427+0000", 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6929999999999999e-06 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454960+0000", 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053344899999999997 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454973+0000", 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2962999999999999e-05 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.695 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454982+0000", 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5019999999999992e-06 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.461659+0000", 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066771679999999998 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.461773+0000", 2024-09-17T16:43:00.696 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113909 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462609+0000", 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083654400000000005 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471322+0000", 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087130349999999992 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.697 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473580+0000", 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022580149999999999 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473625+0000", 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4557e-05 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.698 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:550 3.5s0 3:af4951e1:::smithi18337221-22:head [setxattr _header (57) in=7b] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.454999+0000", 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.163071873, 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018831691000000001, 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 550 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.699 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454999+0000", 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454999+0000", 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.700 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455000+0000", 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6300000000000004e-07 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455004+0000", 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3159999999999998e-06 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455015+0000", 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.057e-05 2024-09-17T16:43:00.701 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455023+0000", 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468685+0000", 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013661819 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.702 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468753+0000", 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8610999999999998e-05 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469078+0000", 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000324622 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471328+0000", 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002249905 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.703 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473758+0000", 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00243071 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473831+0000", 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.25e-05 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.704 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:551 3.5s0 3:af4951e1:::smithi18337221-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.455033+0000", 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.163038093000001, 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022406839000000001, 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 551 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.705 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455033+0000", 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455033+0000", 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.706 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455034+0000", 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5799999999999999e-07 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455036+0000", 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8600000000000001e-06 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455043+0000", 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.707 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455048+0000", 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1100000000000002e-06 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469616+0000", 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01456813 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469663+0000", 2024-09-17T16:43:00.708 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6594000000000001e-05 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.474132+0000", 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044686379999999996 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.474189+0000", 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.709 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.477440+0000", 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032510320000000001 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:633 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~589824] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.452956+0000", 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1651147760000002, 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027916025000000001, 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.710 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 633 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.452956+0000", 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.711 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.452956+0000", 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.452958+0000", 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0530000000000001e-06 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454817+0000", 2024-09-17T16:43:00.712 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001858869 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454832+0000", 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5268e-05 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454839+0000", 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9369999999999998e-06 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.713 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454896+0000", 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6604000000000002e-05 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454978+0000", 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2338999999999999e-05 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456403+0000", 2024-09-17T16:43:00.714 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001424554 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470133+0000", 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013729698 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.480770+0000", 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010637814000000001 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.715 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.480872+0000", 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101889 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:634 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~540672] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.456107+0000", 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1619644999999998, 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024951943000000001, 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.716 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 634 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456107+0000", 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456107+0000", 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456108+0000", 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0899999999999999e-06 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.457301+0000", 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011931730000000001 2024-09-17T16:43:00.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.457316+0000", 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5129e-05 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.457323+0000", 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9949999999999999e-06 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460503+0000", 2024-09-17T16:43:00.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031804720000000002 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460580+0000", 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6725999999999997e-05 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.461390+0000", 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00081024999999999999 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470134+0000", 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008743275 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.480994+0000", 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010860409 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481058+0000", 2024-09-17T16:43:00.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4424000000000005e-05 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:635 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~622592] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.459904+0000", 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1581668780000003, 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021398255000000001, 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.722 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 635 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.459904+0000", 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.459904+0000", 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.459905+0000", 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460548+0000", 2024-09-17T16:43:00.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064323600000000005 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460558+0000", 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4569999999999994e-06 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460565+0000", 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9739999999999996e-06 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.465197+0000", 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046320679999999996 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.465301+0000", 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104683 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.466142+0000", 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084027899999999998 2024-09-17T16:43:00.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.471330+0000", 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051884339999999996 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481226+0000", 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098959479999999999 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481302+0000", 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6296000000000003e-05 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:636 3.cs0 3:38e3a789:::smithi18337221-8:head [setxattr _header (56) in=7b] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.460577+0000", 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1574939889999998, 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020964282000000001, 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.728 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 636 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460577+0000", 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460577+0000", 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460578+0000", 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4900000000000005e-07 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460580+0000", 2024-09-17T16:43:00.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5689999999999999e-06 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460585+0000", 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1919999999999998e-06 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460588+0000", 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3230000000000002e-06 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470174+0000", 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095856139999999992 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470254+0000", 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0918e-05 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470569+0000", 2024-09-17T16:43:00.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031447799999999998 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.471354+0000", 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078461999999999998 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481457+0000", 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01010314 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481541+0000", 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4678999999999993e-05 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:637 3.cs0 3:38e3a789:::smithi18337221-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 5.1574780799999997, 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022673713000000002, 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:00.734 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 637 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-07 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460595+0000", 2024-09-17T16:43:00.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3829999999999999e-06 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460599+0000", 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829999999999998e-06 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460602+0000", 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.444e-06 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470826+0000", 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010223563 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470926+0000", 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100583 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481937+0000", 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011010423 2024-09-17T16:43:00.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.482000+0000", 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3155000000000001e-05 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.483267+0000", 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001266835 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:00.739 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:00.740 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.740 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15] out_osds: [13] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:43:00.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T16:43:00.742 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:00.739+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:00.742 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:43:00.842 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:00.840+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:00.845 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:00.845 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:00.845 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.853 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:43:00.943 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:00.941+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:00.955 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:00.955 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:00.955 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:00.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:43:01.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:01.066 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:01.064+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 47.565893737000003, 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091284039999999997, 2024-09-17T16:43:01.069 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:43:01.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500288+0000", 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8799999999999998e-07 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500609+0000", 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000321482 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500624+0000", 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4558e-05 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500632+0000", 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500693+0000", 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1045999999999998e-05 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500703+0000", 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9899999999999992e-06 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.073 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509375+0000", 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086724420000000007 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509416+0000", 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0639000000000002e-05 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.074 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.543421393000003, 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010249355999999999, 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:01.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:01.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2e-07 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523388+0000", 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062798599999999997 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523412+0000", 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3898999999999999e-05 2024-09-17T16:43:01.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523422+0000", 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0259e-05 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523489+0000", 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7070000000000007e-05 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523500+0000", 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0617e-05 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532963+0000", 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009463183 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.079 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533009+0000", 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5921999999999998e-05 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=20, reqid=client.4553.0:271, at_version=46'13, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.538097719, 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0053659780000000004, 2024-09-17T16:43:01.080 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.081 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528083+0000", 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528084+0000", 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1900000000000002e-07 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.082 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528312+0000", 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000228254 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528326+0000", 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.366e-05 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.528334+0000", 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3000000000000002e-06 2024-09-17T16:43:01.083 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529561+0000", 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001226293 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.529570+0000", 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5820000000000008e-06 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.084 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533417+0000", 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003846576 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533449+0000", 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2694000000000002e-05 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.085 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 37.581049813999996, 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081612969999999996, 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.086 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.087 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485132+0000", 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5699999999999999e-07 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485905+0000", 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077313100000000004 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.088 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485917+0000", 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2092999999999999e-05 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485924+0000", 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7700000000000004e-06 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.089 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485987+0000", 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3487999999999999e-05 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485998+0000", 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0917000000000001e-05 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.090 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493262+0000", 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072639489999999996 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493293+0000", 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0791999999999999e-05 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.091 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.551437630000002, 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014931335, 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.092 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.093 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.99e-07 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515242+0000", 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049758300000000001 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515257+0000", 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.502e-05 2024-09-17T16:43:01.094 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515265+0000", 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515335+0000", 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9536000000000006e-05 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.095 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515345+0000", 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9240000000000002e-06 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529639+0000", 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014294526 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.096 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529675+0000", 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.544416476999999, 2024-09-17T16:43:01.097 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081458920000000001, 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.098 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521766+0000", 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5700000000000001e-07 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.099 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522010+0000", 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024482600000000002 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522025+0000", 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.484e-05 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.100 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522035+0000", 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000001e-06 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522101+0000", 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5848999999999999e-05 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522111+0000", 2024-09-17T16:43:01.101 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0122000000000001e-05 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529879+0000", 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077677559999999998 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529911+0000", 2024-09-17T16:43:01.102 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.459551243, 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048852510000000002, 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.103 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606630+0000", 2024-09-17T16:43:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.606632+0000", 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.547e-06 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607055+0000", 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00042362999999999998 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.105 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607075+0000", 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0128000000000001e-05 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607086+0000", 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0705e-05 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.106 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607170+0000", 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4061999999999996e-05 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.607181+0000", 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1430000000000001e-05 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.107 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611472+0000", 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0042906589999999996 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611515+0000", 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3090000000000002e-05 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.108 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.454784953000001, 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008221562, 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.109 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.110 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611397+0000", 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.71e-07 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611941+0000", 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000544269 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.111 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611963+0000", 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1710999999999999e-05 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611973+0000", 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.112 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612053+0000", 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0012999999999994e-05 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612087+0000", 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4171999999999997e-05 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.113 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619590+0000", 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075029110000000001 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619618+0000", 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7461999999999999e-05 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.114 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=35, reqid=client.4553.0:396, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 32.447713268999998, 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062462430000000003, 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.115 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618469+0000", 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.116 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618513+0000", 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618529+0000", 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6183000000000001e-05 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.117 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618538+0000", 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618616+0000", 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8300999999999995e-05 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618627+0000", 2024-09-17T16:43:01.118 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0750999999999999e-05 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624677+0000", 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060503570000000001 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624714+0000", 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6786999999999999e-05 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.119 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 31.573724885000001, 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079871060000000008, 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.120 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.121 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492457+0000", 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-07 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492641+0000", 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184215 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.122 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492656+0000", 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279000000000001e-05 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492704+0000", 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7738000000000003e-05 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.123 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492882+0000", 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177906 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492916+0000", 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4110999999999999e-05 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500404+0000", 2024-09-17T16:43:01.124 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074877750000000003 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500443+0000", 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9724000000000001e-05 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.125 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 60/34 ECSubWrite(tid=51, reqid=osd.15.0:51, at_version=60'32, trim_to=0'0, roll_forward_to=59'30))", 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.557278877000002, 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.005118587, 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:43:01.126 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508902+0000", 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508903+0000", 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8900000000000001e-07 2024-09-17T16:43:01.127 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508925+0000", 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2251000000000001e-05 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508934+0000", 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8240000000000006e-06 2024-09-17T16:43:01.128 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508941+0000", 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7579999999999992e-06 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.129 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.508998+0000", 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6230999999999997e-05 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509007+0000", 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4879999999999996e-06 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.130 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.513970+0000", 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049629039999999998 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514021+0000", 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0841999999999999e-05 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.131 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 60/34 ECSubWrite(tid=134, reqid=client.4553.0:430, at_version=60'22, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.556206526, 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0049015120000000002, 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.132 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.133 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509975+0000", 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9599999999999999e-07 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.509994+0000", 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8853000000000001e-05 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510005+0000", 2024-09-17T16:43:01.134 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0658e-05 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510012+0000", 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4950000000000002e-06 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510068+0000", 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5566999999999998e-05 2024-09-17T16:43:01.135 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.510077+0000", 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1349999999999998e-06 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514842+0000", 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047653260000000003 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.136 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.514876+0000", 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3782000000000003e-05 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:01.137 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.476546171999999, 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099594590000000004, 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.138 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589636+0000", 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.124e-06 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.139 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590162+0000", 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052565200000000004 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590177+0000", 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5627000000000001e-05 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590187+0000", 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4439999999999997e-06 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590255+0000", 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7867000000000006e-05 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590264+0000", 2024-09-17T16:43:01.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0799999999999995e-06 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599543+0000", 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009279374 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599595+0000", 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1291000000000001e-05 2024-09-17T16:43:01.142 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 27.471861246, 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065491719999999998, 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.143 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594321+0000", 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000005e-07 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594830+0000", 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050941699999999996 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594845+0000", 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4535999999999999e-05 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594855+0000", 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0344e-05 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595268+0000", 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041257099999999998 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595278+0000", 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.048e-05 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600836+0000", 2024-09-17T16:43:01.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055574250000000004 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600869+0000", 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3408999999999998e-05 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.148 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 62/34 ECSubWrite(tid=58, reqid=osd.0.0:58, at_version=62'53, trim_to=0'0, roll_forward_to=61'49))", 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.622583809999998, 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067202670000000003, 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:43:01.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443598+0000", 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:43:01.150 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443624+0000", 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5219999999999999e-05 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443638+0000", 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4470999999999999e-05 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443647+0000", 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4199999999999996e-06 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444249+0000", 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060141600000000002 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.152 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444255+0000", 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4080000000000003e-06 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450282+0000", 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060268819999999999 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450318+0000", 2024-09-17T16:43:01.153 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5553000000000003e-05 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.616364312, 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075788619999999996, 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.154 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449939+0000", 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122082 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449951+0000", 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.129e-05 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449960+0000", 2024-09-17T16:43:01.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4040000000000001e-06 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450024+0000", 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3781999999999993e-05 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450034+0000", 2024-09-17T16:43:01.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0039e-05 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457345+0000", 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073110359999999999 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457396+0000", 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0732999999999997e-05 2024-09-17T16:43:01.159 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.60827033, 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715298, 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.160 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457912+0000", 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.15e-06 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458033+0000", 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121348 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.165 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458055+0000", 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1265000000000001e-05 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458066+0000", 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1483e-05 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.166 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458134+0000", 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7743000000000005e-05 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458144+0000", 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0151e-05 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468594+0000", 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010449974000000001 2024-09-17T16:43:01.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468626+0000", 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2184000000000002e-05 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.168 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 15.603468806, 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087638739999999996, 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:43:01.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462724+0000", 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1761e-05 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462852+0000", 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012799600000000001 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462869+0000", 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6850999999999998e-05 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462879+0000", 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5400000000000001e-06 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462938+0000", 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9449e-05 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462947+0000", 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0909999999999999e-06 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471444+0000", 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084973329999999993 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471476+0000", 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853000000000001e-05 2024-09-17T16:43:01.173 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.590100209999999, 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010450760999999999, 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.174 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476564+0000", 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048279099999999999 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476577+0000", 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3351e-05 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476587+0000", 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8379999999999997e-06 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476667+0000", 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9798999999999999e-05 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476680+0000", 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2764e-05 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486459+0000", 2024-09-17T16:43:01.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097787150000000003 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486532+0000", 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3231000000000004e-05 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.179 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 76/34 ECSubWrite(tid=63, reqid=client.4553.0:603, at_version=76'58, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:49.480924+0000", 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.585257093999999, 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059694029999999999, 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.480924+0000", 2024-09-17T16:43:01.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.480924+0000", 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.480925+0000", 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481271+0000", 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00034631400000000002 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481284+0000", 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3173000000000001e-05 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481291+0000", 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6340000000000003e-06 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481341+0000", 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0285999999999999e-05 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:01.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.481348+0000", 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5259999999999999e-06 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486866+0000", 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055183180000000004 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486894+0000", 2024-09-17T16:43:01.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7322e-05 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:01.185 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:01.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:01.187 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:01.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:01.188 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:01.188 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:43:01.189 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:01.189 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:01.189 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:01.184+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:01.201 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:01.201 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:01.218 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:01.235 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:01.253 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:01.253 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:01.270 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:01.271 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:01.287 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:01.287 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:01.288 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:01.286+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:01.293 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:01.293 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:01.293 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:01.301 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:43:01.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:01.304 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:01.323 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:01.340 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:01.341 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:01.357 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:01.357 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:01.374 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:01.374 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:01.388 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:01.386+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:01.391 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:01.391 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:01.405 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:01.405 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:01.406+0000 7f42c359e640 0 -- 172.21.15.60:0/1679140740 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f42c4221f00 msgr2=0x7f42c42242f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:01.410 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:01.414 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:43:01.445 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T16:43:01.448 INFO:tasks.rados.rados.0.smithi183.stdout:282: done (0 left) 2024-09-17T16:43:01.448 INFO:tasks.rados.rados.0.smithi183.stdout:283: snap_remove snap 27 2024-09-17T16:43:01.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T16:43:01.489 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:01.487+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:01.517 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:01.518 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:01.526 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:43:01.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:43:01.590 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:01.588+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:01.642 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:01.642 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:01.650 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:43:01.691 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:01.689+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:01.753 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:01.753 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:01.762 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:43:01.805 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:01.803+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:01.865 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:01.865 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:01.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:43:01.916 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:01.914+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:01.994 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:01.992+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:02.019 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.019 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.027 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:43:02.095 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:02.093+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:02.171 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.171 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:43:02.224 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:02.222+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:02.281 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.282 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.290 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:43:02.296 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:02.294+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:02.397 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:02.395+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:02.433 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.433 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.442 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:43:02.446 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:43:02.446 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T16:43:02.450 INFO:tasks.rados.rados.0.smithi183.stdout:283: done (0 left) 2024-09-17T16:43:02.450 INFO:tasks.rados.rados.0.smithi183.stdout:284: copy_from oid 46 from oid 45 current snap is 29 2024-09-17T16:43:02.450 INFO:tasks.rados.rados.0.smithi183.stdout:285: copy_from oid 16 from oid 33 current snap is 29 2024-09-17T16:43:02.450 INFO:tasks.rados.rados.0.smithi183.stdout:286: read oid 9 snap -1 2024-09-17T16:43:02.450 INFO:tasks.rados.rados.0.smithi183.stdout:286: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:43:02.451 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 1 current snap is 29 2024-09-17T16:43:02.451 INFO:tasks.rados.rados.0.smithi183.stdout:287: seq_num 113 ranges {0=737280,737280=557056,1294336=606208} 2024-09-17T16:43:02.454 INFO:tasks.rados.rados.0.smithi183.stdout:287: writing smithi18337221-1 from 0 to 737280 tid 1 2024-09-17T16:43:02.458 INFO:tasks.rados.rados.0.smithi183.stdout:287: writing smithi18337221-1 from 737280 to 1294336 tid 2 2024-09-17T16:43:02.462 INFO:tasks.rados.rados.0.smithi183.stdout:287: writing smithi18337221-1 from 1294336 to 1900544 tid 3 2024-09-17T16:43:02.462 INFO:tasks.rados.rados.0.smithi183.stdout:288: snap_create 2024-09-17T16:43:02.462 INFO:tasks.rados.rados.0.smithi183.stdout:284: finishing copy_from to smithi18337221-46 2024-09-17T16:43:02.462 INFO:tasks.rados.rados.0.smithi183.stdout:284: got expected ENOENT (src dne) 2024-09-17T16:43:02.462 INFO:tasks.rados.rados.0.smithi183.stdout:284: finishing copy_from racing read to smithi18337221-46 2024-09-17T16:43:02.462 INFO:tasks.rados.rados.0.smithi183.stdout:286: expect (ObjNum 8 snap 0 seq_num 8) 2024-09-17T16:43:02.463 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:02.464 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 48547 2024-09-17T16:43:02.465 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:02.470 INFO:tasks.rados.rados.0.smithi183.stdout:287: finishing write tid 1 to smithi18337221-1 2024-09-17T16:43:02.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T16:43:02.478 INFO:tasks.rados.rados.0.smithi183.stdout:287: finishing write tid 2 to smithi18337221-1 2024-09-17T16:43:02.479 INFO:tasks.rados.rados.0.smithi183.stdout:287: finishing write tid 3 to smithi18337221-1 2024-09-17T16:43:02.479 INFO:tasks.rados.rados.0.smithi183.stdout:287: finishing write tid 4 to smithi18337221-1 2024-09-17T16:43:02.480 INFO:tasks.rados.rados.0.smithi183.stdout:287: finishing write tid 5 to smithi18337221-1 2024-09-17T16:43:02.481 INFO:tasks.rados.rados.0.smithi183.stdout:287: oid 1 updating version 0 to 189 2024-09-17T16:43:02.481 INFO:tasks.rados.rados.0.smithi183.stdout:287: oid 1 updating version 189 to 191 2024-09-17T16:43:02.481 INFO:tasks.rados.rados.0.smithi183.stdout:287: oid 1 version 191 is already newer than 190 2024-09-17T16:43:02.481 INFO:tasks.rados.rados.0.smithi183.stdout:287: oid 1 updating version 191 to 192 2024-09-17T16:43:02.481 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 1 v 192 (ObjNum 113 snap 29 seq_num 113) dirty exists 2024-09-17T16:43:02.481 INFO:tasks.rados.rados.0.smithi183.stdout:287: left oid 1 (ObjNum 113 snap 29 seq_num 113) 2024-09-17T16:43:02.482 INFO:tasks.rados.rados.0.smithi183.stdout:285: finishing copy_from racing read to smithi18337221-16 2024-09-17T16:43:02.485 INFO:tasks.rados.rados.0.smithi183.stdout:285: finishing copy_from to smithi18337221-16 2024-09-17T16:43:02.485 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 16 v 128 (ObjNum 68 snap 10 seq_num 68) dirty exists 2024-09-17T16:43:02.513 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:02.511+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:02.550 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.551 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.559 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:43:02.603 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:02.601+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:02.661 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.662 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.670 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:43:02.701 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:02.699+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:02.801 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:02.799+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:02.814 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.815 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.823 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:43:02.903 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:02.901+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:02.925 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:02.925 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:02.934 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:43:03.004 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:03.002+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:03.037 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:03.037 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:03.045 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:43:03.105 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:03.103+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:03.161 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:03.161 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:03.170 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:43:03.216 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:03.212+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:03.273 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:03.273 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:03.282 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:43:03.323 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:03.321+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:03.407 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:03.405+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:03.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:43:03.424 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:03.424 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:03.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:43:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T16:43:03.453 INFO:tasks.rados.rados.0.smithi183.stdout:284: done (4 left) 2024-09-17T16:43:03.453 INFO:tasks.rados.rados.0.smithi183.stdout:285: done (3 left) 2024-09-17T16:43:03.453 INFO:tasks.rados.rados.0.smithi183.stdout:286: done (2 left) 2024-09-17T16:43:03.453 INFO:tasks.rados.rados.0.smithi183.stdout:287: done (1 left) 2024-09-17T16:43:03.454 INFO:tasks.rados.rados.0.smithi183.stdout:288: done (0 left) 2024-09-17T16:43:03.454 INFO:tasks.rados.rados.0.smithi183.stdout:289: delete oid 20 current snap is 30 2024-09-17T16:43:03.459 INFO:tasks.rados.rados.0.smithi183.stdout:289: done (0 left) 2024-09-17T16:43:03.459 INFO:tasks.rados.rados.0.smithi183.stdout:290: snap_remove snap 25 2024-09-17T16:43:03.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T16:43:03.508 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:03.506+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:03.557 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:03.557 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:03.559 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:03.560 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:03.565 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:43:03.578 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:03.578 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:03.595 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:03.596 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:03.608 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:03.606+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:03.613 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:03.613 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:03.634 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:03.634 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:03.667 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:03.699 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:03.709 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:03.709 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:03.709 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:03.707+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:03.717 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:43:03.731 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:03.732 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:03.748 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:03.748 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:03.765 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:03.781 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:03.782 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:03.798 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:03.798 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:03.810 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:03.808+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:03.814 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:03.821 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:03.821 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:03.821 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.336874123000001, 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079208060000000007, 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.822 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.823 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481603+0000", 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.75e-07 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482071+0000", 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046812600000000002 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.824 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482084+0000", 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3057000000000001e-05 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482091+0000", 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3540000000000002e-06 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482223+0000", 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013139799999999999 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.825 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482253+0000", 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0824000000000002e-05 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489462+0000", 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007208356 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.826 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489523+0000", 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1216000000000005e-05 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.828 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 44.306859918999997, 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066825230000000001, 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.829 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511616+0000", 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.830 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.511617+0000", 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512095+0000", 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00047857800000000001 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.831 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6481999999999999e-05 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512122+0000", 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0195e-05 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.832 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512212+0000", 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9619999999999999e-05 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.512224+0000", 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1997999999999999e-05 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518268+0000", 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0060445969999999996 2024-09-17T16:43:03.833 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.518299+0000", 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0811e-05 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.325183629999998, 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007546713, 2024-09-17T16:43:03.834 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493293+0000", 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.835 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493294+0000", 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.623e-06 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493665+0000", 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037080199999999999 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493684+0000", 2024-09-17T16:43:03.836 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8737999999999999e-05 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493694+0000", 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9429999999999995e-06 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493819+0000", 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012501100000000001 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.837 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0801999999999999e-05 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.500799+0000", 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00696892 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.500839+0000", 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0874000000000002e-05 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.838 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 60/34 ECSubWrite(tid=146, reqid=osd.4.0:146, at_version=60'57, trim_to=0'0, roll_forward_to=59'55))", 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.308924709999999, 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071068210000000001, 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.839 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509552+0000", 2024-09-17T16:43:03.840 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2500000000000001e-07 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509577+0000", 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5307999999999999e-05 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.509586+0000", 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3380000000000005e-06 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.841 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.510073+0000", 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048690000000000002 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.510157+0000", 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4516000000000002e-05 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.842 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.510168+0000", 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.131e-05 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.516631+0000", 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064626650000000002 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.516658+0000", 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7359e-05 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.843 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.307251848, 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081810830000000005, 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.844 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.845 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.845 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.845 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.845 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:03.845 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.845 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.846 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.846 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.846 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:03.846 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.846 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.846 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511225+0000", 2024-09-17T16:43:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7099999999999998e-07 2024-09-17T16:43:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.848 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511251+0000", 2024-09-17T16:43:03.848 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6346000000000002e-05 2024-09-17T16:43:03.848 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.848 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.848 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.848 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511262+0000", 2024-09-17T16:43:03.849 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0501e-05 2024-09-17T16:43:03.849 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.849 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.849 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.849 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511272+0000", 2024-09-17T16:43:03.849 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9690000000000006e-06 2024-09-17T16:43:03.850 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.850 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.850 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.850 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511337+0000", 2024-09-17T16:43:03.850 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5390999999999998e-05 2024-09-17T16:43:03.850 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.851 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.851 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.851 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511347+0000", 2024-09-17T16:43:03.851 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8840000000000006e-06 2024-09-17T16:43:03.851 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.851 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.852 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.852 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519366+0000", 2024-09-17T16:43:03.852 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080189979999999994 2024-09-17T16:43:03.852 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.852 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.853 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.853 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519406+0000", 2024-09-17T16:43:03.853 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9722999999999999e-05 2024-09-17T16:43:03.853 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.853 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.853 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.854 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.854 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.854 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=60'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:03.854 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.513322+0000", 2024-09-17T16:43:03.854 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.305154353999999, 2024-09-17T16:43:03.854 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067843749999999996, 2024-09-17T16:43:03.855 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.855 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.855 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.855 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.855 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.855 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.856 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513322+0000", 2024-09-17T16:43:03.856 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.856 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.856 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.856 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.856 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513322+0000", 2024-09-17T16:43:03.857 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.857 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.857 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.857 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.857 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513323+0000", 2024-09-17T16:43:03.857 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3e-07 2024-09-17T16:43:03.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.858 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.858 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.858 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513340+0000", 2024-09-17T16:43:03.858 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6986e-05 2024-09-17T16:43:03.858 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.859 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.859 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513352+0000", 2024-09-17T16:43:03.859 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2029e-05 2024-09-17T16:43:03.859 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.859 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.860 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.860 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513358+0000", 2024-09-17T16:43:03.860 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8819999999999998e-06 2024-09-17T16:43:03.860 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.860 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.860 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.861 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.514498+0000", 2024-09-17T16:43:03.861 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00114095 2024-09-17T16:43:03.861 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.861 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.861 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.862 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.514514+0000", 2024-09-17T16:43:03.862 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5412000000000001e-05 2024-09-17T16:43:03.862 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.862 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.862 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.862 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.520075+0000", 2024-09-17T16:43:03.863 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0055611940000000002 2024-09-17T16:43:03.863 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.863 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.863 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.863 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.520106+0000", 2024-09-17T16:43:03.863 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1291999999999998e-05 2024-09-17T16:43:03.864 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.864 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.864 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.864 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.864 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.865 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:03.865 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:03.865 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.300167094999999, 2024-09-17T16:43:03.865 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015298559, 2024-09-17T16:43:03.865 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.865 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.866 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.866 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.866 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.866 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.866 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:03.866 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.867 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.867 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.867 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.867 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:03.867 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.868 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.868 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.868 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518310+0000", 2024-09-17T16:43:03.868 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.049e-06 2024-09-17T16:43:03.868 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.869 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.869 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.869 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518764+0000", 2024-09-17T16:43:03.869 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045328799999999999 2024-09-17T16:43:03.869 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.869 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.870 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518781+0000", 2024-09-17T16:43:03.870 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6999000000000001e-05 2024-09-17T16:43:03.870 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.870 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.870 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518789+0000", 2024-09-17T16:43:03.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8000000000000004e-06 2024-09-17T16:43:03.871 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.871 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.871 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518864+0000", 2024-09-17T16:43:03.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4679999999999996e-05 2024-09-17T16:43:03.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518876+0000", 2024-09-17T16:43:03.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1732e-05 2024-09-17T16:43:03.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533579+0000", 2024-09-17T16:43:03.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014703163 2024-09-17T16:43:03.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533608+0000", 2024-09-17T16:43:03.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8847999999999999e-05 2024-09-17T16:43:03.874 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.875 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.875 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.875 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:03.876 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526182+0000", 2024-09-17T16:43:03.876 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.292294766000001, 2024-09-17T16:43:03.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074684870000000002, 2024-09-17T16:43:03.876 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.876 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.876 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.877 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.877 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526182+0000", 2024-09-17T16:43:03.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.878 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.878 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526182+0000", 2024-09-17T16:43:03.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.879 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.879 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526183+0000", 2024-09-17T16:43:03.879 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0669999999999999e-06 2024-09-17T16:43:03.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.880 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.880 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526515+0000", 2024-09-17T16:43:03.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00033276099999999999 2024-09-17T16:43:03.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.880 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.881 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.881 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526536+0000", 2024-09-17T16:43:03.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0962e-05 2024-09-17T16:43:03.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526545+0000", 2024-09-17T16:43:03.882 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0410000000000003e-06 2024-09-17T16:43:03.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.882 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526610+0000", 2024-09-17T16:43:03.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4678000000000007e-05 2024-09-17T16:43:03.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526617+0000", 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8970000000000002e-06 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533629+0000", 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070116550000000003 2024-09-17T16:43:03.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533650+0000", 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1426000000000001e-05 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.228842059000002, 2024-09-17T16:43:03.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010959406, 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590206+0000", 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000570752 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.887 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590220+0000", 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4301000000000001e-05 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590226+0000", 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1279999999999996e-06 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590291+0000", 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4098999999999997e-05 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590299+0000", 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3659999999999992e-06 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600554+0000", 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010255060999999999 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600594+0000", 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9734000000000003e-05 2024-09-17T16:43:03.889 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.224137188, 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077480170000000003, 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594340+0000", 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7199999999999998e-07 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594802+0000", 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046238699999999998 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594812+0000", 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4490000000000005e-06 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594817+0000", 2024-09-17T16:43:03.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4070000000000001e-06 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594873+0000", 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6187000000000003e-05 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594883+0000", 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0012e-05 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.893 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602063+0000", 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071793839999999996 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602087+0000", 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4519e-05 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.894 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.fs4 61/34 ECSubWrite(tid=57, reqid=osd.13.0:57, at_version=61'8, trim_to=0'0, roll_forward_to=60'6))", 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.302622016000001, 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079238329999999999, 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515855+0000", 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.39e-07 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515885+0000", 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0670999999999998e-05 2024-09-17T16:43:03.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515896+0000", 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0227999999999999e-05 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515904+0000", 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516079+0000", 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017482700000000001 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516092+0000", 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2476e-05 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523739+0000", 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076475459999999999 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523778+0000", 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8964999999999997e-05 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 61/34 ECSubWrite(tid=56, reqid=osd.13.0:56, at_version=61'23, trim_to=0'0, roll_forward_to=60'21))", 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.302080010000001, 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081842100000000008, 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.899 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516397+0000", 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.71e-07 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516421+0000", 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4227e-05 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516436+0000", 2024-09-17T16:43:03.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4278e-05 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516446+0000", 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0132999999999999e-05 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516504+0000", 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8096000000000001e-05 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516511+0000", 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5930000000000002e-06 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524540+0000", 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080295439999999996 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524581+0000", 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0467999999999999e-05 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.903 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 61/34 ECSubWrite(tid=55, reqid=osd.0.0:55, at_version=61'49, trim_to=0'0, roll_forward_to=60'45))", 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.301453425999998, 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075496410000000002, 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517024+0000", 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6800000000000009e-07 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517047+0000", 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2843000000000001e-05 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517063+0000", 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6124999999999999e-05 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517072+0000", 2024-09-17T16:43:03.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7569999999999993e-06 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517136+0000", 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3989e-05 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517146+0000", 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9550000000000004e-06 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524476+0000", 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073308189999999997 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524573+0000", 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6185000000000002e-05 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 61/34 ECSubWrite(tid=164, reqid=osd.4.0:164, at_version=61'37, trim_to=0'0, roll_forward_to=60'35))", 2024-09-17T16:43:03.908 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.517262+0000", 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.301213880999999, 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072875530000000004, 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517262+0000", 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.909 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517262+0000", 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517263+0000", 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3300000000000001e-07 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517280+0000", 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6945000000000001e-05 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517288+0000", 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4279999999999996e-06 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517297+0000", 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0410000000000003e-06 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517359+0000", 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2285000000000004e-05 2024-09-17T16:43:03.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517367+0000", 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6909999999999997e-06 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524516+0000", 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071488100000000002 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524550+0000", 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4220000000000001e-05 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 61/34 ECSubWrite(tid=165, reqid=osd.4.0:165, at_version=61'24, trim_to=0'0, roll_forward_to=60'22))", 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.518537+0000", 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.299939266999999, 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067717569999999998, 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.913 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518537+0000", 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518537+0000", 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518550+0000", 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3281e-05 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518586+0000", 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5549000000000001e-05 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518601+0000", 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5118e-05 2024-09-17T16:43:03.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518610+0000", 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6389999999999998e-06 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518698+0000", 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8552000000000002e-05 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518711+0000", 2024-09-17T16:43:03.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2306999999999999e-05 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525273+0000", 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065627469999999999 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525309+0000", 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5564e-05 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.917 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 61/34 ECSubWrite(tid=166, reqid=osd.4.0:166, at_version=61'39, trim_to=0'0, roll_forward_to=60'35))", 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.299844476000001, 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066949940000000001, 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:43:03.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518632+0000", 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8700000000000001e-07 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518669+0000", 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.7150000000000002e-05 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518684+0000", 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4980000000000001e-05 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518693+0000", 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1689999999999992e-06 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518751+0000", 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8168999999999998e-05 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.518760+0000", 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5300000000000002e-06 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525295+0000", 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0065346170000000004 2024-09-17T16:43:03.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.525327+0000", 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1992000000000001e-05 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 25.364218878999999, 2024-09-17T16:43:03.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088600729999999996, 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:03.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454258+0000", 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455027+0000", 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00076834799999999997 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455042+0000", 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5009e-05 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455048+0000", 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6560000000000003e-06 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0324e-05 2024-09-17T16:43:03.925 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455119+0000", 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0755e-05 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463081+0000", 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079613089999999997 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463118+0000", 2024-09-17T16:43:03.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6878999999999997e-05 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 76/34 ECSubWrite(tid=63, reqid=client.4553.0:603, at_version=76'58, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.480897+0000", 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.33757939, 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064193599999999998, 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.927 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.480897+0000", 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.480897+0000", 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.480898+0000", 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3900000000000004e-07 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481282+0000", 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038432499999999998 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481292+0000", 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4760000000000004e-06 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481299+0000", 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6040000000000004e-06 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481352+0000", 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2389999999999998e-05 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.481361+0000", 2024-09-17T16:43:03.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4299999999999995e-06 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487277+0000", 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0059156369999999996 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487316+0000", 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9659000000000001e-05 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 82/77 ECSubWrite(tid=55, reqid=client.4553.0:669, at_version=82'41, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.1384514899999996, 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082065909999999992, 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:03.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.36e-07 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680539+0000", 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051415599999999999 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680553+0000", 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3949e-05 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680561+0000", 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.926e-06 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680619+0000", 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8400000000000003e-05 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680628+0000", 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7290000000000006e-06 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.688193+0000", 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00756495 2024-09-17T16:43:03.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.688231+0000", 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8345e-05 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 4.2888905069999996, 2024-09-17T16:43:03.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0084683799999999993, 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:03.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529587+0000", 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.153e-06 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530391+0000", 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00080430200000000001 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530407+0000", 2024-09-17T16:43:03.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5998000000000002e-05 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530416+0000", 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1700000000000003e-06 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530479+0000", 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2488000000000002e-05 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:03.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530490+0000", 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0764000000000001e-05 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.538031+0000", 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075414239999999997 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.538054+0000", 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3081000000000001e-05 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.940 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.941 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.941 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:03.941 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:03.941 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:03.942 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:03.942 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:03.943 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:03.943 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:43:03.944 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:03.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:03.846+0000 7fd75bfff640 0 -- 172.21.15.60:0/2906546311 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7fd75c224070 msgr2=0x7fd75c226460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:43:03.944 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:03.940+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:04.043 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:04.041+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:04.066 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:04.088 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:04.088 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:04.088 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:04.088 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:04.097 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:43:04.181 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:04.179+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:04.240 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:04.240 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:04.241 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:04.241 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:04.241 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:04.245 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:04.243+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:04.249 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:43:04.346 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:04.344+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:04.393 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:04.393 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:04.393 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:04.393 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:04.393 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.393 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4353.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 69.275743520999995, 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019887846000000001, 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4353", 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 1 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.394 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.395 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114602+0000", 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4899999999999999e-06 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114608+0000", 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5269999999999998e-06 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114617+0000", 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.396 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114624+0000", 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114751+0000", 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012672599999999999 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114762+0000", 2024-09-17T16:43:04.397 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0988000000000001e-05 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133140+0000", 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018378205000000002 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.398 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133255+0000", 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011454 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 5", 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133361+0000", 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134291+0000", 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00092989899999999998 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.399 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134428+0000", 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013742100000000001 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134460+0000", 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1696000000000003e-05 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134488+0000", 2024-09-17T16:43:04.400 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8839999999999998e-05 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:180 3.8s0 3:1f669f2f:::smithi18337221-38:head [copy-from ver 4] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.929800145000002, 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539511, 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.401 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 180 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.402 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.403 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.403 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.403 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:43:04.403 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.403 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.404 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.404 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460545+0000", 2024-09-17T16:43:04.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789999999999999e-06 2024-09-17T16:43:04.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460557+0000", 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1426e-05 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460574+0000", 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7201e-05 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460585+0000", 2024-09-17T16:43:04.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1151e-05 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460659+0000", 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3627000000000005e-05 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460665+0000", 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8799999999999996e-06 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465756+0000", 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050914580000000001 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465824+0000", 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7695999999999997e-05 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.471499+0000", 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056752800000000004 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474733+0000", 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336159999999999 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475885+0000", 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011522209999999999 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475939+0000", 2024-09-17T16:43:04.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4075e-05 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:181 3.8s0 3:1f669f2f:::smithi18337221-38:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.929737299000003, 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012676972999999999, 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.409 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 181 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460607+0000", 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7700000000000005e-07 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460610+0000", 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.255e-06 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460615+0000", 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4210000000000003e-06 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460619+0000", 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9580000000000001e-06 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460721+0000", 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000101939 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460728+0000", 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8040000000000004e-06 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466017+0000", 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052897680000000002 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.466075+0000", 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7250999999999998e-05 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473120+0000", 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070448159999999998 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473208+0000", 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8794000000000004e-05 2024-09-17T16:43:04.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.473284+0000", 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5489999999999997e-05 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:205 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~540672] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.903740255999999, 2024-09-17T16:43:04.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022798883999999998, 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 205 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:43:04.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486616+0000", 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2235999999999999e-05 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487273+0000", 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065649800000000004 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487287+0000", 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4691e-05 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487297+0000", 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6360000000000006e-06 2024-09-17T16:43:04.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488723+0000", 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014264239999999999 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488837+0000", 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011340000000000001 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.419 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490257+0000", 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014198100000000001 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503813+0000", 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013556586000000001 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509302+0000", 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054885029999999996 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001011 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:206 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.900559747999999, 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020001278000000001, 2024-09-17T16:43:04.421 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 206 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489787+0000", 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.193e-06 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490081+0000", 2024-09-17T16:43:04.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029397100000000002 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490112+0000", 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1084999999999998e-05 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490123+0000", 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1440999999999999e-05 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498510+0000", 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083867290000000008 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498626+0000", 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011602700000000001 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499572+0000", 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00094589999999999995 2024-09-17T16:43:04.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504786+0000", 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005214148 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509716+0000", 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049301520000000001 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509786+0000", 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9632e-05 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:207 3.8s0 3:1b608a02:::smithi18337221-50:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.900201567000003, 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020510362000000001, 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.427 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 207 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490149+0000", 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.135e-06 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490157+0000", 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9060000000000002e-06 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490162+0000", 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1229999999999999e-06 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505559+0000", 2024-09-17T16:43:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539709 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505695+0000", 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135969 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506337+0000", 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064216000000000002 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507545+0000", 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012081609999999999 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510574+0000", 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030285519999999999 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510653+0000", 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9348e-05 2024-09-17T16:43:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:208 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.900173506000002, 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021610111000000001, 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.433 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 208 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490174+0000", 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7350000000000001e-06 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490181+0000", 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9890000000000003e-06 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490186+0000", 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2299999999999999e-06 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506594+0000", 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016408049000000001 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507224+0000", 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000629881 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510953+0000", 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037285399999999998 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511114+0000", 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016097400000000001 2024-09-17T16:43:04.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511781+0000", 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066716099999999999 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:368 3.8s0 3:1b608a02:::smithi18337221-50:b [read 1295654~457434,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.887686158000001, 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0099805280000000007, 2024-09-17T16:43:04.438 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.439 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.439 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.440 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 368 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502658+0000", 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502659+0000", 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5499999999999998e-07 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502663+0000", 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0269999999999997e-06 2024-09-17T16:43:04.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502670+0000", 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.502676+0000", 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3269999999999997e-06 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.510962+0000", 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082857139999999996 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.511066+0000", 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010427199999999999 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.512639+0000", 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015722690000000001 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.444 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 55/34 ECSubWrite(tid=33, reqid=client.4553.0:394, at_version=55'26, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.783404576000002, 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011225425000000001, 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606940+0000", 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.606941+0000", 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0869999999999999e-06 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607290+0000", 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034908900000000002 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607308+0000", 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8522999999999999e-05 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607322+0000", 2024-09-17T16:43:04.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3582e-05 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607407+0000", 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5463000000000005e-05 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.607417+0000", 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6090000000000007e-06 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618132+0000", 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010714672999999999 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.618165+0000", 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3399000000000003e-05 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:04.449 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.871637680999999, 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01393165, 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518707+0000", 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.47e-07 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519373+0000", 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066530699999999996 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519390+0000", 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7329e-05 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519407+0000", 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7022999999999999e-05 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519617+0000", 2024-09-17T16:43:04.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000209564 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519641+0000", 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4725000000000001e-05 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532562+0000", 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012920769 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532638+0000", 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5986000000000001e-05 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.863898292000002, 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0093138409999999998, 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.454 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526446+0000", 2024-09-17T16:43:04.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526447+0000", 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7599999999999997e-07 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526616+0000", 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000169803 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526630+0000", 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3246e-05 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526638+0000", 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9859999999999994e-06 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527416+0000", 2024-09-17T16:43:04.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00077817999999999995 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527426+0000", 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.012e-05 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.535735+0000", 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083096039999999999 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.535760+0000", 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4226000000000001e-05 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.800576965000001, 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011351075, 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.459 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589767+0000", 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589768+0000", 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5000000000000002e-07 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590376+0000", 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000607812 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590388+0000", 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1968e-05 2024-09-17T16:43:04.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590393+0000", 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5929999999999996e-06 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590459+0000", 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5939999999999995e-05 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.462 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590466+0000", 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8390000000000001e-06 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601035+0000", 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010569017999999999 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.601118+0000", 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3154999999999999e-05 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.463 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.es1 61/34 ECSubWrite(tid=149, reqid=osd.2.0:149, at_version=61'51, trim_to=0'0, roll_forward_to=60'49))", 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.876925274000001, 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0097004719999999999, 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513419+0000", 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.41e-07 2024-09-17T16:43:04.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513443+0000", 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4164000000000001e-05 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513452+0000", 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1449999999999997e-06 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513459+0000", 2024-09-17T16:43:04.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1739999999999997e-06 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513548+0000", 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9395999999999996e-05 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513559+0000", 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1191e-05 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522009+0000", 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0084501660000000003 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523119+0000", 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011099949999999999 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.468 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.9139412, 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0095130030000000008, 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476403+0000", 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3099999999999999e-07 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477138+0000", 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000735022 2024-09-17T16:43:04.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477149+0000", 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.099e-05 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477157+0000", 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2290000000000003e-06 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477249+0000", 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1145999999999998e-05 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477258+0000", 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6989999999999998e-06 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.485884+0000", 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086257880000000006 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.485916+0000", 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1897999999999999e-05 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s5 82/77 ECSubWrite(tid=100, reqid=client.4553.0:656, at_version=82'22, trim_to=0'0, roll_forward_to=78'19))", 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.662090+0000", 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7282545539999994, 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011350861, 2024-09-17T16:43:04.473 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662090+0000", 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662090+0000", 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662091+0000", 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0210000000000001e-06 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662407+0000", 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000316569 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662419+0000", 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1372999999999999e-05 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662424+0000", 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8760000000000002e-06 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662502+0000", 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8003000000000005e-05 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662514+0000", 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1629e-05 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.673405+0000", 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010891428 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.673440+0000", 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4962000000000002e-05 2024-09-17T16:43:04.477 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:664 3.8s0 3:1f669f2f:::smithi18337221-38:head [read 0~1835008,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.664992+0000", 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7253524250000005, 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094175279999999997, 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.478 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 664 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.664992+0000", 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.664992+0000", 2024-09-17T16:43:04.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.664992+0000", 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6599999999999996e-07 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.664996+0000", 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5410000000000001e-06 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665006+0000", 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0098000000000001e-05 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665012+0000", 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2940000000000002e-06 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.667523+0000", 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0025107250000000001 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.667613+0000", 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0135000000000004e-05 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.674409+0000", 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067960690000000001 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.482 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:665 3.8s0 3:1f669f2f:::smithi18337221-38:head [read 0~1835008,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.665031+0000", 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7253130500000005, 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012183070000000001, 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 665 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665031+0000", 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665031+0000", 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665032+0000", 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4900000000000001e-07 2024-09-17T16:43:04.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665035+0000", 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9809999999999999e-06 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665043+0000", 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0309999999999998e-06 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665048+0000", 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4709999999999998e-06 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.674473+0000", 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094251130000000006 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.674533+0000", 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9925e-05 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.486 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.677214+0000", 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0026811000000000001 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:666 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~0,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.665057+0000", 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7252871200000008, 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010711554, 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.487 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 666 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665057+0000", 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.488 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665057+0000", 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665058+0000", 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4199999999999996e-07 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665062+0000", 2024-09-17T16:43:04.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.3100000000000002e-06 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665072+0000", 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8209999999999997e-06 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665077+0000", 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5459999999999999e-06 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.674775+0000", 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0096975220000000001 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.675613+0000", 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000838311 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.675769+0000", 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00015550199999999999 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:667 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.665100+0000", 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7252439519999996, 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010843739999999999, 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.492 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 667 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665100+0000", 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665100+0000", 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665101+0000", 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8999999999999996e-07 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665105+0000", 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2429999999999999e-06 2024-09-17T16:43:04.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665113+0000", 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0809999999999994e-06 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665120+0000", 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6150000000000002e-06 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.675804+0000", 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010684107999999999 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.675854+0000", 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0226000000000003e-05 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.675944+0000", 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9777000000000005e-05 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.496 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:668 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.665129+0000", 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 8.7252149629999991, 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011401774999999999, 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.497 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 668 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665129+0000", 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665129+0000", 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665130+0000", 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.58e-07 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665132+0000", 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6840000000000001e-06 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665139+0000", 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7900000000000002e-06 2024-09-17T16:43:04.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.665145+0000", 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.229e-06 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.676339+0000", 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011193755 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.676422+0000", 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2766e-05 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.676531+0000", 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010909299999999999 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.501 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:04.502 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:43:04.504 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T16:43:04.504 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:43:04.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T16:43:04.505 INFO:tasks.rados.rados.0.smithi183.stdout:290: done (0 left) 2024-09-17T16:43:04.505 INFO:tasks.rados.rados.0.smithi183.stdout:291: read oid 31 snap -1 2024-09-17T16:43:04.506 INFO:tasks.rados.rados.0.smithi183.stdout:291: expect deleted 2024-09-17T16:43:04.506 INFO:tasks.rados.rados.0.smithi183.stdout:292: setattr oid 38 current snap is 30 2024-09-17T16:43:04.506 INFO:tasks.rados.rados.0.smithi183.stdout:293: snap_remove snap 29 2024-09-17T16:43:04.506 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:04.500+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:04.604 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:04.602+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:04.647 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:04.647 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:04.647 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:04.647 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:04.656 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:43:04.704 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:04.703+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:04.758 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:04.758 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:04.758 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:04.758 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:04.759 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:04.767 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:43:04.810 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:04.808+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:04.871 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.871 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.377507682000001, 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080373609999999998, 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.872 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490837+0000", 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9900000000000001e-07 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490977+0000", 2024-09-17T16:43:04.873 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000139412 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490997+0000", 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.052e-05 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491011+0000", 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4304999999999999e-05 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.874 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491130+0000", 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011833900000000001 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491143+0000", 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2986000000000001e-05 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498835+0000", 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076927319999999999 2024-09-17T16:43:04.875 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498874+0000", 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8668000000000003e-05 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 45/34 ECSubWrite(tid=30, reqid=client.4553.0:251, at_version=45'7, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:43:04.876 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 46.360140653000002, 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0091817740000000002, 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.877 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508204+0000", 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.91e-07 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508622+0000", 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041787699999999998 2024-09-17T16:43:04.878 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508636+0000", 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4331999999999999e-05 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508644+0000", 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.879 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508713+0000", 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9888000000000006e-05 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.508723+0000", 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.713e-06 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517349+0000", 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086254179999999993 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.880 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:18.517386+0000", 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6971000000000002e-05 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:270 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~655360] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 45.347908783999998, 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013861503000000001, 2024-09-17T16:43:04.881 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 270 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.882 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520438+0000", 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0849999999999999e-06 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520784+0000", 2024-09-17T16:43:04.883 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034672700000000002 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520799+0000", 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4945e-05 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520809+0000", 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999997e-06 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.884 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520888+0000", 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9523000000000004e-05 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.521021+0000", 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013319300000000001 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522568+0000", 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015468770000000001 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.885 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085082820000000007 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534240+0000", 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031634889999999998 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534297+0000", 2024-09-17T16:43:04.886 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:271 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 45.345513658000002, 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01199191, 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.887 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 271 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.888 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522833+0000", 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.889e-06 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523129+0000", 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029651599999999998 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.889 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523150+0000", 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0537e-05 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523159+0000", 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2329999999999995e-06 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527318+0000", 2024-09-17T16:43:04.890 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041587719999999998 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527398+0000", 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0752000000000002e-05 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527918+0000", 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051932300000000003 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.891 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531167+0000", 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032495649999999998 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534786+0000", 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036188050000000001 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534823+0000", 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6517999999999998e-05 2024-09-17T16:43:04.892 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:272 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 45.345165236, 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011828584, 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.893 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 272 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.894 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523180+0000", 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523184+0000", 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1989999999999999e-06 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523202+0000", 2024-09-17T16:43:04.895 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7932999999999999e-05 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523210+0000", 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5050000000000001e-06 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530456+0000", 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072466300000000004 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.896 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3615999999999995e-05 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530847+0000", 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032758 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.897 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531332+0000", 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048465900000000002 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534949+0000", 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036167159999999999 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535008+0000", 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9038e-05 2024-09-17T16:43:04.898 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:273 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 45.345122384, 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012586701, 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.899 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 273 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523223+0000", 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523226+0000", 2024-09-17T16:43:04.901 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2150000000000001e-06 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9100000000000005e-06 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523241+0000", 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1899999999999998e-06 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.902 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531097+0000", 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078564370000000008 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531159+0000", 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535259+0000", 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041002670000000003 2024-09-17T16:43:04.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535355+0000", 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5707999999999999e-05 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535809+0000", 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045409299999999998 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.904 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:297 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~737280] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 41.386354359999999, 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011819003, 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 297 2024-09-17T16:43:04.905 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.906 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481992+0000", 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.001e-06 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482367+0000", 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037461699999999999 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482382+0000", 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5693e-05 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.907 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482389+0000", 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.08e-06 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482440+0000", 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0917000000000001e-05 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482445+0000", 2024-09-17T16:43:04.908 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6410000000000001e-06 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484030+0000", 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001585328 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484091+0000", 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0677999999999997e-05 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.909 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.485118+0000", 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010273400000000001 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493041+0000", 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079222289999999994 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493728+0000", 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00068753100000000001 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.910 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493809+0000", 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0947999999999998e-05 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:298 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 41.383990416000003, 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011840491999999999, 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.911 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 298 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.912 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484355+0000", 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0249999999999999e-06 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484537+0000", 2024-09-17T16:43:04.913 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018172699999999999 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484548+0000", 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1202999999999999e-05 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484555+0000", 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4839999999999998e-06 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.914 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489700+0000", 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051447760000000002 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489765+0000", 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4311000000000001e-05 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.490228+0000", 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046323600000000001 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.915 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493079+0000", 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028515580000000001 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496152+0000", 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030726970000000001 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.916 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496195+0000", 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2475000000000002e-05 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:299 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 41.383772151000002, 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01186708, 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.917 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 299 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.918 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484573+0000", 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2399999999999998e-07 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484576+0000", 2024-09-17T16:43:04.919 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4920000000000002e-06 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484582+0000", 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.096e-06 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484587+0000", 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2390000000000002e-06 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.920 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492444+0000", 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078571289999999992 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492500+0000", 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5806000000000001e-05 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.921 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492763+0000", 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00026361899999999998 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493177+0000", 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041339600000000001 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496387+0000", 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032098970000000002 2024-09-17T16:43:04.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496439+0000", 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2781999999999997e-05 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:300 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 41.383749117999997, 2024-09-17T16:43:04.923 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012900164, 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 300 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:43:04.924 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484596+0000", 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.63e-07 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.925 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484599+0000", 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1690000000000001e-06 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484607+0000", 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484612+0000", 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1379999999999998e-06 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.926 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492930+0000", 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083180240000000003 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492979+0000", 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9021999999999999e-05 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496702+0000", 2024-09-17T16:43:04.927 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037230459999999998 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496783+0000", 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1225999999999998e-05 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.497495+0000", 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00071229699999999997 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.928 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.356479962000002, 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094427290000000004, 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.929 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511865+0000", 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4000000000000001e-07 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.930 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511882+0000", 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6923e-05 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511889+0000", 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9609999999999999e-06 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511895+0000", 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8889999999999996e-06 2024-09-17T16:43:04.931 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511967+0000", 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1373999999999998e-05 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511978+0000", 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1080999999999999e-05 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.932 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521259+0000", 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092809539999999992 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521307+0000", 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8406999999999999e-05 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.933 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=46, reqid=osd.0.0:46, at_version=60'41, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.354688546999999, 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083410159999999997, 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.934 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513656+0000", 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513657+0000", 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4200000000000005e-07 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513684+0000", 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7339999999999999e-05 2024-09-17T16:43:04.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513698+0000", 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3611000000000001e-05 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513706+0000", 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6829999999999997e-06 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.936 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513924+0000", 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000217359 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.513939+0000", 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5177000000000001e-05 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521961+0000", 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080218340000000003 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.937 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521997+0000", 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6170000000000001e-05 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.278415327000001, 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010035229, 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.938 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.939 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589930+0000", 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.105e-06 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590524+0000", 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059383899999999998 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590544+0000", 2024-09-17T16:43:04.940 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0292000000000002e-05 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590555+0000", 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0344e-05 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590629+0000", 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4610000000000006e-05 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.941 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590640+0000", 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0969e-05 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599920+0000", 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092792629999999994 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599964+0000", 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4807e-05 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.942 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=50, reqid=client.4553.0:456, at_version=60'44, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 31.269868259999999, 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007014335, 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.943 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598476+0000", 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598477+0000", 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7000000000000003e-07 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.944 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598555+0000", 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8207000000000005e-05 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598570+0000", 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4885000000000001e-05 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.598579+0000", 2024-09-17T16:43:04.945 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0000000000000002e-06 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600037+0000", 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014582600000000001 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600047+0000", 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6010000000000001e-06 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.946 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.605456+0000", 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054086220000000001 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.605491+0000", 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.489e-05 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.8s3 61/34 ECSubWrite(tid=30, reqid=osd.11.0:30, at_version=61'24, trim_to=0'0, roll_forward_to=60'22))", 2024-09-17T16:43:04.947 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 30.354627228999998, 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0068967539999999997, 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.948 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513717+0000", 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513718+0000", 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8500000000000002e-07 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513739+0000", 2024-09-17T16:43:04.949 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1386000000000002e-05 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513747+0000", 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2700000000000004e-06 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513755+0000", 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5490000000000001e-06 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.950 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513812+0000", 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6907999999999998e-05 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513819+0000", 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1760000000000004e-06 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520574+0000", 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067552089999999999 2024-09-17T16:43:04.951 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.520614+0000", 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9971000000000001e-05 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 62/34 ECSubWrite(tid=75, reqid=osd.14.0:75, at_version=62'47, trim_to=0'0, roll_forward_to=61'43))", 2024-09-17T16:43:04.952 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.421739424999998, 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078703769999999996, 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.953 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446605+0000", 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446606+0000", 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0690000000000001e-06 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446635+0000", 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8538999999999999e-05 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.954 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446647+0000", 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2617e-05 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.446656+0000", 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4700000000000002e-06 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.447766+0000", 2024-09-17T16:43:04.955 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001110516 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.447778+0000", 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1338999999999999e-05 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.454450+0000", 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0066719530000000004 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.956 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.454475+0000", 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5874e-05 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s4 62/34 ECSubWrite(tid=48, reqid=osd.8.0:48, at_version=62'40, trim_to=0'0, roll_forward_to=61'36))", 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 29.418873161, 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074745189999999998, 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.957 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449471+0000", 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.958 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449472+0000", 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9299999999999998e-07 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449495+0000", 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3354e-05 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449505+0000", 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9210000000000004e-06 2024-09-17T16:43:04.959 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.449513+0000", 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6939999999999995e-06 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.450155+0000", 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064195400000000003 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.960 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.450164+0000", 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5959999999999993e-06 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.456910+0000", 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0067456679999999998 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:35.456946+0000", 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5738999999999998e-05 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.961 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.39187091, 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010964612, 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.962 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9399999999999999e-07 2024-09-17T16:43:04.963 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476883+0000", 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000408978 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476900+0000", 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6883000000000001e-05 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.964 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476910+0000", 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0842999999999999e-05 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476992+0000", 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.161e-05 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477005+0000", 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2581e-05 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.965 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487394+0000", 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01038942 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487438+0000", 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4103000000000001e-05 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.966 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s1 91/77 ECSubWrite(tid=328, reqid=osd.4.0:325, at_version=0'0, trim_to=0'0, roll_forward_to=91'53))", 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:04.455620+0000", 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.412724072, 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073701890000000001, 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455620+0000", 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.967 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455620+0000", 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455621+0000", 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6300000000000005e-07 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455630+0000", 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4369999999999996e-06 2024-09-17T16:43:04.968 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455640+0000", 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3670000000000003e-06 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455647+0000", 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2980000000000003e-06 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.969 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455705+0000", 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7361999999999997e-05 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.455715+0000", 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0135e-05 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.462942+0000", 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072275050000000004 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.970 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.462991+0000", 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8421999999999998e-05 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.9s3 91/34 ECSubWrite(tid=123, reqid=osd.14.0:123, at_version=91'60, trim_to=0'0, roll_forward_to=85'58))", 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:04.457824+0000", 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.41052060499999998, 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077715639999999999, 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:04.971 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457824+0000", 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457824+0000", 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:04.972 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457824+0000", 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9099999999999999e-07 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457849+0000", 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4343999999999999e-05 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457857+0000", 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3979999999999999e-06 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.973 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457864+0000", 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5170000000000002e-06 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457944+0000", 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.975e-05 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.457953+0000", 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1819999999999995e-06 2024-09-17T16:43:04.974 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.465571+0000", 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076170910000000003 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.465595+0000", 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4890999999999999e-05 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.975 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:04.976 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:04.976 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:04.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:43:04.978 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:04.975+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:05.078 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:05.076+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:05.085 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:05.085 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:05.085 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:05.086 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:05.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:43:05.179 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:05.177+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:05.201 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:05.201 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:05.201 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:05.201 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:05.201 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:05.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:43:05.280 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:05.278+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:05.359 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:209 3.6s0 3:6d4c68b4:::smithi18337221-35:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 51.866254669, 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019587552000000001, 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.360 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 209 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490471+0000", 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.492e-06 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490480+0000", 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:43:05.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490502+0000", 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2005e-05 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490512+0000", 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0129000000000001e-05 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490586+0000", 2024-09-17T16:43:05.363 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4232000000000003e-05 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490679+0000", 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2909000000000001e-05 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497687+0000", 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070084520000000001 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506016+0000", 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0083282830000000006 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509967+0000", 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039514509999999999 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510056+0000", 2024-09-17T16:43:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8918000000000005e-05 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 51.866088894000001, 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018101223999999999, 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:05.366 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490635+0000", 2024-09-17T16:43:05.367 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492045+0000", 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001410644 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492086+0000", 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0726999999999998e-05 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492098+0000", 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2163e-05 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492226+0000", 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012778900000000001 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492241+0000", 2024-09-17T16:43:05.369 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4932e-05 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508691+0000", 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016449693000000001 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508735+0000", 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4768999999999998e-05 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:221 3.6s0 3:6f1c8401:::smithi18337221-16:head [copy-from ver 2] snapc 4=[4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e41)", 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.885453462000001, 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014566234000000001, 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 221 2024-09-17T16:43:05.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471270+0000", 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471271+0000", 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1039999999999999e-06 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471276+0000", 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.378e-06 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471289+0000", 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2612999999999999e-05 2024-09-17T16:43:05.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471301+0000", 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2046e-05 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471355+0000", 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4512999999999998e-05 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.471361+0000", 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0549999999999996e-06 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475700+0000", 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004338789 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.475828+0000", 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012755000000000001 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.481497+0000", 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056689610000000001 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.483484+0000", 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0019870399999999998 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.485768+0000", 2024-09-17T16:43:05.376 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022843389999999998 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:14.485836+0000", 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7846000000000001e-05 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:372 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~507904] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:05.377 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.844029065999997, 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017260719000000001, 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 372 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.378 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512696+0000", 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8700000000000001e-06 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513289+0000", 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059281000000000004 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513305+0000", 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6494000000000002e-05 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513312+0000", 2024-09-17T16:43:05.380 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5889999999999999e-06 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513379+0000", 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6659e-05 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513491+0000", 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011233199999999999 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.381 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514868+0000", 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001377407 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.525432+0000", 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010563863 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529881+0000", 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044490329999999998 2024-09-17T16:43:05.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529955+0000", 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3662e-05 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:376 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.838271614, 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015816857, 2024-09-17T16:43:05.383 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 376 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.06e-07 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.385 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518456+0000", 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6679999999999999e-06 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518474+0000", 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8652e-05 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518481+0000", 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2920000000000001e-06 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.386 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529124+0000", 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010643556 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529173+0000", 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8321e-05 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533229+0000", 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040568990000000001 2024-09-17T16:43:05.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533274+0000", 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5016999999999999e-05 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.534268+0000", 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00099394599999999989 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:396 3.6s0 3:6f1c8401:::smithi18337221-16:head [append 0~98304] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610119+0000", 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.746603927000002, 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014839274, 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 396 2024-09-17T16:43:05.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610119+0000", 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610119+0000", 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.390 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610120+0000", 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1680000000000001e-06 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610226+0000", 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010588 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610236+0000", 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0163000000000001e-05 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.391 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610242+0000", 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.242e-06 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.617957+0000", 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0077157700000000003 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.392 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.618044+0000", 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6972999999999996e-05 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.618441+0000", 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039642699999999998 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619605+0000", 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001164296 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.624914+0000", 2024-09-17T16:43:05.394 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00530921 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.624959+0000", 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4144999999999998e-05 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:397 3.6s0 3:6f1c8401:::smithi18337221-16:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:43:05.395 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.746466470000001, 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015018178, 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 397 2024-09-17T16:43:05.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610257+0000", 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:43:05.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.399 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.399 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.399 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610260+0000", 2024-09-17T16:43:05.399 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2189999999999998e-06 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610263+0000", 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9380000000000002e-06 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610267+0000", 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8689999999999997e-06 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.400 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619735+0000", 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0094680600000000004 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.619840+0000", 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104749 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.620351+0000", 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00051100899999999999 2024-09-17T16:43:05.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.620941+0000", 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058999900000000001 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625182+0000", 2024-09-17T16:43:05.402 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042407169999999998 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625275+0000", 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3015000000000003e-05 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:398 3.6s0 3:6f1c8401:::smithi18337221-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.746450451000001, 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015904456000000001, 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 398 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.404 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.405 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.405 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4400000000000001e-07 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.406 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610275+0000", 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0490000000000002e-06 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610279+0000", 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7570000000000002e-06 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610282+0000", 2024-09-17T16:43:05.407 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4139999999999998e-06 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621112+0000", 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010829319 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621164+0000", 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2238999999999999e-05 2024-09-17T16:43:05.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625667+0000", 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0045036399999999997 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625718+0000", 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0970000000000002e-05 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.409 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.626177+0000", 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045872399999999998 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:458 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 31.764393518999999, 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014907866000000001, 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.410 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 458 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.411 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592330+0000", 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7799999999999997e-07 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.412 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592331+0000", 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3680000000000001e-06 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592336+0000", 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0150000000000003e-06 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.592339+0000", 2024-09-17T16:43:05.413 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0149999999999999e-06 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599765+0000", 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00742605 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.599818+0000", 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2621999999999999e-05 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.414 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.606231+0000", 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0064125739999999999 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.606284+0000", 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3001000000000003e-05 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.607238+0000", 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00095394299999999996 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.415 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:602 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~557056] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.884795370999999, 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020848021000000001, 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.416 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 602 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471930+0000", 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4210000000000002e-06 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472516+0000", 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058545400000000001 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.418 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472540+0000", 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4527000000000001e-05 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472550+0000", 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5920000000000007e-06 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472637+0000", 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7214999999999998e-05 2024-09-17T16:43:05.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472648+0000", 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.474838+0000", 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0021897409999999998 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.474925+0000", 2024-09-17T16:43:05.420 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6918999999999999e-05 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476046+0000", 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011207319999999999 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492584+0000", 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016537854000000001 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.421 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492709+0000", 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012510599999999999 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492776+0000", 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7058999999999996e-05 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:603 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~638976] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.881433993, 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017813141000000001, 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 603 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475290+0000", 2024-09-17T16:43:05.424 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.209e-06 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476082+0000", 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079194400000000005 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476100+0000", 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7829000000000002e-05 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.425 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476107+0000", 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8059999999999997e-06 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480053+0000", 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039456170000000002 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480139+0000", 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6389000000000002e-05 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480834+0000", 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00069457000000000004 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492585+0000", 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01175114 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493048+0000", 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00046288200000000002 2024-09-17T16:43:05.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493102+0000", 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4755e-05 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:604 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~524288] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.479479+0000", 2024-09-17T16:43:05.428 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.877244213000001, 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015104019, 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 604 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.479479+0000", 2024-09-17T16:43:05.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.479479+0000", 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.479480+0000", 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5069999999999999e-06 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480034+0000", 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00055392400000000002 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480047+0000", 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2391999999999999e-05 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480053+0000", 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6619999999999999e-06 2024-09-17T16:43:05.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.487908+0000", 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078549190000000001 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.488023+0000", 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115117 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.489054+0000", 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001030572 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494160+0000", 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051063819999999996 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494534+0000", 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00037384400000000002 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494583+0000", 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8699999999999998e-05 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:605 3.6s0 3:6d4c68b4:::smithi18337221-35:head [setxattr _header (57) in=7b] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.480069+0000", 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.876654099, 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015621507, 2024-09-17T16:43:05.434 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 605 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480069+0000", 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480069+0000", 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480070+0000", 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8599999999999998e-07 2024-09-17T16:43:05.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480072+0000", 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3410000000000001e-06 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480077+0000", 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6809999999999997e-06 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480080+0000", 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3400000000000002e-06 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493165+0000", 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013085266999999999 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493288+0000", 2024-09-17T16:43:05.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012213400000000001 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493846+0000", 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00055891600000000001 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494593+0000", 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00074671099999999995 2024-09-17T16:43:05.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.495637+0000", 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001043792 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.495691+0000", 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3638999999999999e-05 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:606 3.6s0 3:6d4c68b4:::smithi18337221-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.876637555, 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017083732000000001, 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.441 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 606 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8999999999999998e-07 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480087+0000", 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4339999999999999e-06 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480091+0000", 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9360000000000001e-06 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480094+0000", 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9900000000000002e-06 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494631+0000", 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014536445 2024-09-17T16:43:05.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494697+0000", 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5832000000000003e-05 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.496058+0000", 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001361623 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.496104+0000", 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5401999999999997e-05 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.497169+0000", 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010657799999999999 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:631 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~3850240,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9104849609999999, 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016155756, 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 631 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446239+0000", 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6700000000000003e-07 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446242+0000", 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5200000000000002e-06 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446247+0000", 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.164e-06 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446251+0000", 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6660000000000001e-06 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446397+0000", 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014552 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446403+0000", 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5440000000000004e-06 2024-09-17T16:43:05.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.449745+0000", 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033422790000000001 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.449869+0000", 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012339100000000001 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462394+0000", 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012525105 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:632 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~3850240,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9104455710000003, 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020060099000000001, 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.452 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 632 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1e-07 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446281+0000", 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.309e-06 2024-09-17T16:43:05.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446292+0000", 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0852999999999999e-05 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446301+0000", 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6000000000000007e-06 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446432+0000", 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013141800000000001 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446442+0000", 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8099999999999992e-06 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.451647+0000", 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052050009999999999 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.451706+0000", 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9515999999999997e-05 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466338+0000", 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014631282000000001 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:05.460 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.8941821460000003, 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017904584000000001, 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462542+0000", 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7400000000000003e-07 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462693+0000", 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015141899999999999 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462706+0000", 2024-09-17T16:43:05.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2813000000000001e-05 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462714+0000", 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2609999999999993e-06 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462976+0000", 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026219399999999999 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462986+0000", 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5259999999999999e-06 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480397+0000", 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017411357999999998 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480446+0000", 2024-09-17T16:43:05.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8439000000000002e-05 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.8939849829999993, 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017745053, 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462739+0000", 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2900000000000004e-07 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462963+0000", 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00022424899999999999 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462976+0000", 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2843999999999999e-05 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462984+0000", 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2320000000000001e-06 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.469986+0000", 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070019690000000002 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.469993+0000", 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4309999999999997e-06 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480453+0000", 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010459163 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480483+0000", 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0636000000000003e-05 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.466267+0000", 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.8904564879999999, 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014748226, 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466267+0000", 2024-09-17T16:43:05.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466267+0000", 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466268+0000", 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466872+0000", 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00060436400000000003 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466885+0000", 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2695e-05 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466903+0000", 2024-09-17T16:43:05.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8365000000000001e-05 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.474076+0000", 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071725000000000001 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.474086+0000", 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0817e-05 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480990+0000", 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0069033439999999996 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.481015+0000", 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5150000000000001e-05 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 85/34 ECSubWrite(tid=305, reqid=client.4553.0:683, at_version=85'114, trim_to=0'0, roll_forward_to=85'113))", 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 6.8326123059999997, 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018433593000000002, 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:05.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4899999999999995e-07 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524216+0000", 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010487100000000001 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524228+0000", 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.169e-05 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524235+0000", 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0790000000000003e-06 2024-09-17T16:43:05.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524306+0000", 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0479000000000001e-05 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524317+0000", 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1772e-05 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.542459+0000", 2024-09-17T16:43:05.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018142121000000001 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.542544+0000", 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5031999999999995e-05 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.480 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:05.482 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:05.479+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:05.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:43:05.484 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T16:43:05.485 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:43:05.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T16:43:05.487 INFO:tasks.rados.rados.0.smithi183.stdout:293: done (2 left) 2024-09-17T16:43:05.487 INFO:tasks.rados.rados.0.smithi183.stdout:294: copy_from oid 37 from oid 25 current snap is 30 2024-09-17T16:43:05.487 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 38 v 44 (ObjNum 100 snap 21 seq_num 100) dirty exists 2024-09-17T16:43:05.487 INFO:tasks.rados.rados.0.smithi183.stdout:291: done (2 left) 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:292: done (1 left) 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 22 current snap is 30 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:295: seq_num 115 ranges {278528=770048,1048576=704512,1753088=458752} 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:295: writing smithi18337221-22 from 278528 to 1048576 tid 1 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:295: writing smithi18337221-22 from 1048576 to 1753088 tid 2 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:295: writing smithi18337221-22 from 1753088 to 2211840 tid 3 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:296: read oid 15 snap -1 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:296: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:297: read oid 6 snap 23 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:297: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:298: snap_create 2024-09-17T16:43:05.488 INFO:tasks.rados.rados.0.smithi183.stdout:297: expect (ObjNum 5 snap 0 seq_num 5) 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 84298 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 54958 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: finishing write tid 1 to smithi18337221-22 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: finishing write tid 2 to smithi18337221-22 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: finishing write tid 3 to smithi18337221-22 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: finishing write tid 4 to smithi18337221-22 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: finishing write tid 5 to smithi18337221-22 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: oid 22 updating version 0 to 66 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: oid 22 updating version 66 to 69 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: oid 22 version 69 is already newer than 68 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:295: oid 22 version 69 is already newer than 67 2024-09-17T16:43:05.489 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 22 v 69 (ObjNum 115 snap 30 seq_num 115) dirty exists 2024-09-17T16:43:05.490 INFO:tasks.rados.rados.0.smithi183.stdout:295: left oid 22 (ObjNum 115 snap 30 seq_num 115) 2024-09-17T16:43:05.490 INFO:tasks.rados.rados.0.smithi183.stdout:294: finishing copy_from racing read to smithi18337221-37 2024-09-17T16:43:05.500 INFO:tasks.rados.rados.0.smithi183.stdout:294: finishing copy_from to smithi18337221-37 2024-09-17T16:43:05.500 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 20 (ObjNum 72 snap 10 seq_num 72) dirty exists 2024-09-17T16:43:05.500 INFO:tasks.rados.rados.0.smithi183.stdout:296: expect (ObjNum 29 snap 0 seq_num 29) 2024-09-17T16:43:05.501 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:05.505 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:05.509 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:05.583 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:05.581+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:05.634 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:05.634 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:05.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:43:05.686 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:05.684+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:05.785 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:05.783+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:05.792 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:05.792 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:05.793 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:05.793 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:05.793 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:05.801 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:43:05.886 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:05.884+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:43:05.910 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.431578483000003, 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:43:05.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:43:05.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.917 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.429645729999997, 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:43:05.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:43:05.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:43:05.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.429218739, 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:43:05.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:43:05.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.429185275000002, 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.931 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.429138969, 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:43:05.937 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:43:05.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.940 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:43:05.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.429079115999997, 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:43:05.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:43:05.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:43:05.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.949 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(osd.5.23:2 3.bs0 3:d08ffbb6:::smithi18337221-30:head [assert-version v8,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.423808674999997, 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025206989999999999, 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483330+0000", 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483332+0000", 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9630000000000001e-06 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483339+0000", 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483351+0000", 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2378000000000001e-05 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.483359+0000", 2024-09-17T16:43:05.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506020+0000", 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022660777 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506121+0000", 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010158999999999999 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508537+0000", 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002415848 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:351 3.7s0 3:e31d051c:::smithi18337221-15:head [copy-from ver 8] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 37.427661184000002, 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023291879000000001, 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.954 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 351 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479478+0000", 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479479+0000", 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.671e-06 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479487+0000", 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.763e-06 2024-09-17T16:43:05.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479504+0000", 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6891000000000001e-05 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479513+0000", 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0690000000000008e-06 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479567+0000", 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3599e-05 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479657+0000", 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9906000000000003e-05 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.493160+0000", 2024-09-17T16:43:05.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013503724999999999 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.500514+0000", 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0073532679999999996 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502657+0000", 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002143407 2024-09-17T16:43:05.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.502770+0000", 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011258 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:352 3.7s0 3:e31d051c:::smithi18337221-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:43:05.960 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 37.427606734000001, 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020327753, 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 352 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479532+0000", 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479533+0000", 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3200000000000005e-07 2024-09-17T16:43:05.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479537+0000", 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.403e-06 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479548+0000", 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0444e-05 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479555+0000", 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0559999999999999e-06 2024-09-17T16:43:05.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479795+0000", 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023998499999999999 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.479858+0000", 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2729000000000002e-05 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499619+0000", 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019761535 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499738+0000", 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000118867 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499860+0000", 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012210199999999999 2024-09-17T16:43:05.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:433 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~622592] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.391619099000003, 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019410863, 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.966 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 433 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515520+0000", 2024-09-17T16:43:05.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.515522+0000", 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8160000000000001e-06 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516965+0000", 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0014435629999999999 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516981+0000", 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5681000000000001e-05 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.516991+0000", 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8239999999999995e-06 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517069+0000", 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8172999999999998e-05 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.517201+0000", 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000132101 2024-09-17T16:43:05.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.518296+0000", 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010954490000000001 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532966+0000", 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014669013 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534841+0000", 2024-09-17T16:43:05.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018757509999999999 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.534931+0000", 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9492000000000003e-05 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:435 3.1s0 3:845a4d43:::smithi18337221-2:head [append 0~294912] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.386277042000003, 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018146874, 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.973 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 435 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520862+0000", 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.520863+0000", 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4050000000000001e-06 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521158+0000", 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00029489000000000002 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521173+0000", 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5228000000000001e-05 2024-09-17T16:43:05.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521184+0000", 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0332999999999999e-05 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529465+0000", 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082808810000000004 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.529536+0000", 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.161e-05 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.530071+0000", 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053491699999999999 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533025+0000", 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002953401 2024-09-17T16:43:05.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.538970+0000", 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059453010000000001 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539009+0000", 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8908000000000001e-05 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:436 3.1s0 3:845a4d43:::smithi18337221-2:head [setxattr _header (56) in=7b] snapc e=[e,b,8] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.385940589999997, 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017989387999999999, 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 436 2024-09-17T16:43:05.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521198+0000", 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521199+0000", 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9999999999999997e-07 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521213+0000", 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4215e-05 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521223+0000", 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9340000000000001e-06 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521229+0000", 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0329999999999997e-06 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532021+0000", 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010791558 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532136+0000", 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115529 2024-09-17T16:43:05.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.532681+0000", 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054450799999999997 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533396+0000", 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071506499999999997 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539125+0000", 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0057293409999999998 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539188+0000", 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2504999999999999e-05 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:437 3.1s0 3:845a4d43:::smithi18337221-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:05.984 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 32.38589958, 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018905465, 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 437 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521239+0000", 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521240+0000", 2024-09-17T16:43:05.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521242+0000", 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.43e-06 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521251+0000", 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4910000000000005e-06 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.521256+0000", 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0629999999999996e-06 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533246+0000", 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011990466999999999 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.533313+0000", 2024-09-17T16:43:05.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7045999999999995e-05 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539424+0000", 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0061101920000000004 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.539475+0000", 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1892999999999999e-05 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:33.540145+0000", 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00066938200000000005 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:544 3.bs0 3:d08ffbb6:::smithi18337221-30:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e71)", 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 21.449036056000001, 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018041647000000001, 2024-09-17T16:43:05.990 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 544 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:43:05.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458103+0000", 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458104+0000", 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8299999999999996e-07 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458106+0000", 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6139999999999999e-06 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458117+0000", 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0536e-05 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.458122+0000", 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5099999999999998e-06 2024-09-17T16:43:05.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.473227+0000", 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015105084 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.473280+0000", 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2886999999999997e-05 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475521+0000", 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0022407680000000002 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.475616+0000", 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4841999999999998e-05 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:44.476145+0000", 2024-09-17T16:43:05.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052872300000000004 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:694 3.7s0 3:e2406a2d:::smithi18337221-4:head [append 0~720896] snapc 1c=[1c,1b,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:59.519342+0000", 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 6.3877965110000003, 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020797704, 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:05.996 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 694 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.519342+0000", 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.519342+0000", 2024-09-17T16:43:05.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.519343+0000", 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3699999999999999e-07 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.520573+0000", 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012299940000000001 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.520584+0000", 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0197000000000001e-05 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.520592+0000", 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3729999999999993e-06 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.520628+0000", 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6510000000000001e-05 2024-09-17T16:43:05.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.520707+0000", 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8948000000000004e-05 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.521519+0000", 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00081155400000000003 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:06.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.538590+0000", 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017071372000000001 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.540087+0000", 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001497019 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:59.540140+0000", 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2800000000000003e-05 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.001 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:722 3.7s0 3:edf9cac5:::smithi18337221-37:head [copy-from ver 20] snapc 1f=[1e,1c,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.447807+0000", 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.45933218399999998, 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.050674622000000002, 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:06.002 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 722 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447807+0000", 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447807+0000", 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447809+0000", 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.782e-06 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447816+0000", 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2980000000000003e-06 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447832+0000", 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6249999999999999e-05 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447841+0000", 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447906+0000", 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5164000000000002e-05 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447915+0000", 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6829999999999997e-06 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451020+0000", 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031045370000000001 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451125+0000", 2024-09-17T16:43:06.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010541500000000001 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.469682+0000", 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018557138000000001 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489936+0000", 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020253818999999999 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.498406+0000", 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084702939999999997 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.498481+0000", 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.008 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:723 3.7s0 3:edf9cac5:::smithi18337221-37:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.459278028, 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.040894345999999998, 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 723 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:06.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5200000000000002e-07 2024-09-17T16:43:06.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447864+0000", 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.937e-06 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447873+0000", 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0250000000000008e-06 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:06.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447879+0000", 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9190000000000004e-06 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447984+0000", 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104571 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447991+0000", 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2860000000000002e-06 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451292+0000", 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033009900000000002 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451341+0000", 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8511999999999999e-05 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488623+0000", 2024-09-17T16:43:06.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037282167999999997 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488686+0000", 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2792000000000005e-05 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488755+0000", 2024-09-17T16:43:06.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9694000000000001e-05 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:729 3.7s0 3:e31d051c:::smithi18337221-15:head [read 0~491520,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.461755+0000", 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.44538409400000001, 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.036062661000000003, 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:06.015 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 729 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461755+0000", 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461755+0000", 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461757+0000", 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.61e-06 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461763+0000", 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8800000000000002e-06 2024-09-17T16:43:06.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461780+0000", 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6541e-05 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461787+0000", 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8680000000000001e-06 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488789+0000", 2024-09-17T16:43:06.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027002103999999999 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488840+0000", 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1520000000000001e-05 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.497818+0000", 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0089771380000000008 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.019 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:730 3.7s0 3:e31d051c:::smithi18337221-15:head [read 0~491520,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.445334116, 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.036471573, 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:06.020 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 730 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0200000000000002e-07 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461810+0000", 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1389999999999997e-06 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461818+0000", 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8990000000000001e-06 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461823+0000", 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2809999999999999e-06 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489583+0000", 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027759872000000001 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489637+0000", 2024-09-17T16:43:06.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4713999999999998e-05 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.498276+0000", 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086390660000000008 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:731 3.7s0 3:e31d051c:::smithi18337221-15:head [read 0~491520,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 0.44530796299999997, 2024-09-17T16:43:06.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037401763999999997, 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 731 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:06.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2899999999999999e-07 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:06.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461839+0000", 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5909999999999998e-06 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461846+0000", 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.81e-06 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461851+0000", 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7770000000000002e-06 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.490181+0000", 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028330854999999999 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.490242+0000", 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0127999999999998e-05 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.499233+0000", 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0089911739999999993 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.029 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:06.029 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:06.029 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:06.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:43:06.031 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:06.028+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:06.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:06.131 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:06.128+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:06.179 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:06.189 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:43:06.232 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:06.230+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:06.242 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:06.242 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:06.260 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:06.260 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:06.280 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:06.280 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:06.295 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:06.295 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:06.298 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:06.299 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:06.299 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:06.299 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:06.299 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:06.308 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:43:06.312 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:06.312 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:06.330 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:06.331 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:06.333 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:06.331+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:06.348 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:06.348 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:06.366 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:06.366 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:06.382 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:06.382 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:06.400 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:06.401 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:06.416 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:06.416 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:06.417 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:06.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:43:06.434 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:06.434 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:06.434 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:06.432+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:06.447 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T16:43:06.450 INFO:tasks.rados.rados.0.smithi183.stdout:294: done (4 left) 2024-09-17T16:43:06.450 INFO:tasks.rados.rados.0.smithi183.stdout:295: done (3 left) 2024-09-17T16:43:06.450 INFO:tasks.rados.rados.0.smithi183.stdout:296: done (2 left) 2024-09-17T16:43:06.450 INFO:tasks.rados.rados.0.smithi183.stdout:297: done (1 left) 2024-09-17T16:43:06.451 INFO:tasks.rados.rados.0.smithi183.stdout:298: done (0 left) 2024-09-17T16:43:06.451 INFO:tasks.rados.rados.0.smithi183.stdout:299: read oid 31 snap -1 2024-09-17T16:43:06.451 INFO:tasks.rados.rados.0.smithi183.stdout:299: expect deleted 2024-09-17T16:43:06.451 INFO:tasks.rados.rados.0.smithi183.stdout:300: delete oid 44 current snap is 31 2024-09-17T16:43:06.451 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:06.451 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:06.456 INFO:tasks.rados.rados.0.smithi183.stdout:299: done (1 left) 2024-09-17T16:43:06.456 INFO:tasks.rados.rados.0.smithi183.stdout:300: done (0 left) 2024-09-17T16:43:06.457 INFO:tasks.rados.rados.0.smithi183.stdout:301: rollback oid 31 current snap is 31 2024-09-17T16:43:06.457 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 31 to 17 2024-09-17T16:43:06.457 INFO:tasks.rados.rados.0.smithi183.stdout:302: snap_create 2024-09-17T16:43:06.457 INFO:tasks.rados.rados.0.smithi183.stdout:301: finishing rollback tid 1 to smithi18337221-31 2024-09-17T16:43:06.457 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 31 v 0 (ObjNum 65 snap 0 seq_num 1464815455) dirty dne 2024-09-17T16:43:06.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T16:43:06.471 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:06.488 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:06.490 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:06.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:06.487+0000 7f3ac9f31640 0 -- 172.21.15.60:0/2994295357 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f3ac4221f80 msgr2=0x7f3ac4224370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:43:06.534 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:06.532+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:06.547 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:06.547 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:06.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:43:06.635 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:06.633+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:06.705 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:06.705 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:06.708 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:06.708 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:06.714 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:43:06.736 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:06.734+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:06.821 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:06.822 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:06.830 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:43:06.837 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:06.835+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:06.938 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:06.936+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:06.945 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:06.945 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:06.955 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:43:07.038 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:07.036+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:07.058 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.058 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.067 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:43:07.139 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:07.137+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:07.170 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.170 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.179 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:43:07.240 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:07.238+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:07.281 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.281 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.290 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:43:07.341 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:07.339+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:07.393 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.393 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.402 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:43:07.442 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:07.441+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:07.448 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:301: done (1 left) 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:302: done (0 left) 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:303: copy_from oid 10 from oid 23 current snap is 32 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:304: read oid 5 snap -1 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:304: expect (ObjNum 4 snap 0 seq_num 4) 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:305: rollback oid 44 current snap is 32 2024-09-17T16:43:07.452 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 44 to 24 2024-09-17T16:43:07.453 INFO:tasks.rados.rados.0.smithi183.stdout:306: read oid 28 snap -1 2024-09-17T16:43:07.453 INFO:tasks.rados.rados.0.smithi183.stdout:306: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:43:07.453 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 43 current snap is 32 2024-09-17T16:43:07.453 INFO:tasks.rados.rados.0.smithi183.stdout:307: seq_num 117 ranges {638976=425984,1064960=606208,1671168=540672,2211840=409600} 2024-09-17T16:43:07.458 INFO:tasks.rados.rados.0.smithi183.stdout:307: writing smithi18337221-43 from 638976 to 1064960 tid 1 2024-09-17T16:43:07.462 INFO:tasks.rados.rados.0.smithi183.stdout:307: writing smithi18337221-43 from 1064960 to 1671168 tid 2 2024-09-17T16:43:07.465 INFO:tasks.rados.rados.0.smithi183.stdout:307: writing smithi18337221-43 from 1671168 to 2211840 tid 3 2024-09-17T16:43:07.467 INFO:tasks.rados.rados.0.smithi183.stdout:307: writing smithi18337221-43 from 2211840 to 2621440 tid 4 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:308: rmattr oid 18 current snap is 32 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:308: done (5 left) 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:309: delete oid 26 current snap is 32 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:305: finishing rollback tid 1 to smithi18337221-44 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:304: expect (ObjNum 4 snap 0 seq_num 4) 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:07.468 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:07.469 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:07.470 INFO:tasks.rados.rados.0.smithi183.stdout:305: finishing rollback tid 2 to smithi18337221-44 2024-09-17T16:43:07.470 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 44 v 57 (ObjNum 52 snap 0 seq_num 52) dirty exists 2024-09-17T16:43:07.470 INFO:tasks.rados.rados.0.smithi183.stdout:306: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:43:07.470 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:07.471 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T16:43:07.475 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:07.479 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:07.484 INFO:tasks.rados.rados.0.smithi183.stdout:303: finishing copy_from racing read to smithi18337221-10 2024-09-17T16:43:07.484 INFO:tasks.rados.rados.0.smithi183.stdout:307: finishing write tid 1 to smithi18337221-43 2024-09-17T16:43:07.484 INFO:tasks.rados.rados.0.smithi183.stdout:307: finishing write tid 2 to smithi18337221-43 2024-09-17T16:43:07.485 INFO:tasks.rados.rados.0.smithi183.stdout:307: finishing write tid 3 to smithi18337221-43 2024-09-17T16:43:07.485 INFO:tasks.rados.rados.0.smithi183.stdout:307: finishing write tid 4 to smithi18337221-43 2024-09-17T16:43:07.485 INFO:tasks.rados.rados.0.smithi183.stdout:307: finishing write tid 5 to smithi18337221-43 2024-09-17T16:43:07.486 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:43:07.487 INFO:tasks.rados.rados.0.smithi183.stdout:304: done (5 left) 2024-09-17T16:43:07.487 INFO:tasks.rados.rados.0.smithi183.stdout:305: done (4 left) 2024-09-17T16:43:07.487 INFO:tasks.rados.rados.0.smithi183.stdout:306: done (3 left) 2024-09-17T16:43:07.487 INFO:tasks.rados.rados.0.smithi183.stdout:309: done (2 left) 2024-09-17T16:43:07.487 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 6 current snap is 32 2024-09-17T16:43:07.487 INFO:tasks.rados.rados.0.smithi183.stdout:310: seq_num 119 ranges {1916928=458752,2375680=507904,2883584=507904,3391488=458752,3850240=81920} 2024-09-17T16:43:07.499 INFO:tasks.rados.rados.0.smithi183.stdout:310: writing smithi18337221-6 from 1916928 to 2375680 tid 1 2024-09-17T16:43:07.502 INFO:tasks.rados.rados.0.smithi183.stdout:310: writing smithi18337221-6 from 2375680 to 2883584 tid 2 2024-09-17T16:43:07.505 INFO:tasks.rados.rados.0.smithi183.stdout:310: writing smithi18337221-6 from 2883584 to 3391488 tid 3 2024-09-17T16:43:07.507 INFO:tasks.rados.rados.0.smithi183.stdout:310: writing smithi18337221-6 from 3391488 to 3850240 tid 4 2024-09-17T16:43:07.508 INFO:tasks.rados.rados.0.smithi183.stdout:310: writing smithi18337221-6 from 3850240 to 3932160 tid 5 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:311: delete oid 12 current snap is 32 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: finishing write tid 6 to smithi18337221-43 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: oid 43 updating version 0 to 102 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: oid 43 updating version 102 to 103 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: oid 43 version 103 is already newer than 101 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: oid 43 updating version 103 to 104 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: oid 43 updating version 104 to 105 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 105 (ObjNum 117 snap 32 seq_num 117) dirty exists 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:307: left oid 43 (ObjNum 117 snap 32 seq_num 117) 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:303: finishing copy_from to smithi18337221-10 2024-09-17T16:43:07.509 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 10 v 133 (ObjNum 93 snap 18 seq_num 93) dirty exists 2024-09-17T16:43:07.510 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 1 to smithi18337221-6 2024-09-17T16:43:07.511 INFO:tasks.rados.rados.0.smithi183.stdout:303: done (3 left) 2024-09-17T16:43:07.511 INFO:tasks.rados.rados.0.smithi183.stdout:307: done (2 left) 2024-09-17T16:43:07.511 INFO:tasks.rados.rados.0.smithi183.stdout:311: done (1 left) 2024-09-17T16:43:07.511 INFO:tasks.rados.rados.0.smithi183.stdout:312: delete oid 3 current snap is 32 2024-09-17T16:43:07.511 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 2 to smithi18337221-6 2024-09-17T16:43:07.514 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.514 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.516 INFO:tasks.rados.rados.0.smithi183.stdout:312: done (1 left) 2024-09-17T16:43:07.516 INFO:tasks.rados.rados.0.smithi183.stdout:313: snap_remove snap 23 2024-09-17T16:43:07.524 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:43:07.568 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:07.566+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:07.627 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.627 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.636 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:43:07.644 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:07.642+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:07.744 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:07.742+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:07.778 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.778 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.786 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:43:07.845 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:07.843+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:07.888 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:07.888 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:07.897 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:43:07.947 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:07.945+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:08.040 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.040 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.047 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:08.045+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:08.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:43:08.148 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:08.146+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:08.151 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.151 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.160 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:43:08.248 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:08.246+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:08.304 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.304 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.313 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:43:08.354 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:08.352+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:08.426 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.427 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.435 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:43:08.449 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:43:08.450 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:08.448+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:08.452 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T16:43:08.453 INFO:tasks.rados.rados.0.smithi183.stdout:313: done (1 left) 2024-09-17T16:43:08.453 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 37 current snap is 32 2024-09-17T16:43:08.453 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 3 to smithi18337221-6 2024-09-17T16:43:08.453 INFO:tasks.rados.rados.0.smithi183.stdout:314: seq_num 122 ranges {2473984=507904,2981888=425984,3407872=442368,3850240=540672,4390912=147456} 2024-09-17T16:43:08.470 INFO:tasks.rados.rados.0.smithi183.stdout:314: writing smithi18337221-37 from 2473984 to 2981888 tid 1 2024-09-17T16:43:08.473 INFO:tasks.rados.rados.0.smithi183.stdout:314: writing smithi18337221-37 from 2981888 to 3407872 tid 2 2024-09-17T16:43:08.476 INFO:tasks.rados.rados.0.smithi183.stdout:314: writing smithi18337221-37 from 3407872 to 3850240 tid 3 2024-09-17T16:43:08.479 INFO:tasks.rados.rados.0.smithi183.stdout:314: writing smithi18337221-37 from 3850240 to 4390912 tid 4 2024-09-17T16:43:08.480 INFO:tasks.rados.rados.0.smithi183.stdout:314: writing smithi18337221-37 from 4390912 to 4538368 tid 5 2024-09-17T16:43:08.480 INFO:tasks.rados.rados.0.smithi183.stdout:315: snap_remove snap 30 2024-09-17T16:43:08.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-17T16:43:08.550 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:08.548+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:08.554 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.554 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.563 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:43:08.651 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:08.649+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:08.665 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.666 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.674 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:43:08.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:43:08.758 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:08.756+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:08.817 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:08.817 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:08.825 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:43:08.846 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:08.847 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:08.864 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:08.865 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:08.866 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:08.864+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:08.882 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:08.882 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:08.900 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:08.916 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:08.917 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:08.934 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:08.934 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:08.951 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:08.954 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:08.953+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:08.967 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:08.968 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:08.968 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:08.969 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:08.976 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:43:08.985 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:09.002 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:09.020 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:09.038 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:09.054 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:09.054 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:09.055 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:09.053+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:09.071 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:09.071 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:09.088 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:09.088 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:09.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:09.102+0000 7fd0337fe640 0 -- 172.21.15.60:0/3632580333 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7fd0342225f0 msgr2=0x7fd034224a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:09.107 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:09.120 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:09.120 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.625369085999999, 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089069189999999993, 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492597+0000", 2024-09-17T16:43:09.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493106+0000", 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050891100000000002 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493115+0000", 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8079999999999999e-06 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493123+0000", 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8259999999999993e-06 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493203+0000", 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0124999999999996e-05 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493212+0000", 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8340000000000005e-06 2024-09-17T16:43:09.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501463+0000", 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082505530000000007 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501503+0000", 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9965000000000001e-05 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.606344606, 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016927722999999999, 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:43:09.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511621+0000", 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512062+0000", 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044157400000000002 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512083+0000", 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1058999999999999e-05 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512094+0000", 2024-09-17T16:43:09.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0559e-05 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512185+0000", 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1187999999999995e-05 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512196+0000", 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0668e-05 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528498+0000", 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016302408000000001 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528548+0000", 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9808000000000002e-05 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 46/34 ECSubWrite(tid=63, reqid=client.4553.0:266, at_version=46'34, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:43:09.130 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.600808915999998, 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011393616000000001, 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517157+0000", 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4600000000000003e-07 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517245+0000", 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8442999999999993e-05 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517258+0000", 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2527999999999999e-05 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517267+0000", 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1230000000000006e-06 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517400+0000", 2024-09-17T16:43:09.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133015 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517409+0000", 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8980000000000002e-06 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528486+0000", 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011077053999999999 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528550+0000", 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3708999999999996e-05 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 49.597837276, 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093715889999999996, 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.135 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520129+0000", 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0759999999999999e-06 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520297+0000", 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168049 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520317+0000", 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-09-17T16:43:09.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520326+0000", 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6269999999999995e-06 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520397+0000", 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0418000000000002e-05 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520406+0000", 2024-09-17T16:43:09.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529445+0000", 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090386540000000001 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529499+0000", 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4462000000000001e-05 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.139 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=129, reqid=client.4553.0:353, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.627771793000001, 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01022205, 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490194+0000", 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2330000000000001e-06 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490267+0000", 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2262999999999996e-05 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490279+0000", 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2446000000000001e-05 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490288+0000", 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-09-17T16:43:09.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490363+0000", 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4833999999999995e-05 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490371+0000", 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2640000000000008e-06 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500387+0000", 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010015242000000001 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500415+0000", 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8512000000000001e-05 2024-09-17T16:43:09.144 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.624743445, 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085314020000000004, 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.145 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493221+0000", 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493222+0000", 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8100000000000001e-07 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493630+0000", 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040793900000000001 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493642+0000", 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1742e-05 2024-09-17T16:43:09.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493655+0000", 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3207000000000001e-05 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493706+0000", 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0887999999999998e-05 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493716+0000", 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3810000000000005e-06 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501720+0000", 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080045050000000003 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501753+0000", 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2858999999999998e-05 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.149 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 40.621658795000002, 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010886477, 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496307+0000", 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496400+0000", 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2985000000000005e-05 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496415+0000", 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4674e-05 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496423+0000", 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2870000000000004e-06 2024-09-17T16:43:09.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496478+0000", 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5077999999999997e-05 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496488+0000", 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.153 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507159+0000", 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010670513 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507193+0000", 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3884999999999998e-05 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:43:09.154 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 39.615812102, 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010661874999999999, 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502154+0000", 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1999999999999998e-07 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502368+0000", 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000213904 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502383+0000", 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5447999999999998e-05 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502395+0000", 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1589e-05 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502457+0000", 2024-09-17T16:43:09.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2644000000000005e-05 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502467+0000", 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0206e-05 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512759+0000", 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010291234999999999 2024-09-17T16:43:09.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512815+0000", 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6029000000000002e-05 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 60/34 ECSubWrite(tid=130, reqid=osd.5.0:130, at_version=60'19, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.613555916999999, 2024-09-17T16:43:09.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082366980000000006, 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504409+0000", 2024-09-17T16:43:09.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504410+0000", 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.186e-06 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504450+0000", 2024-09-17T16:43:09.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9808999999999998e-05 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504480+0000", 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0326000000000001e-05 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504488+0000", 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.96e-06 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504566+0000", 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8146999999999996e-05 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.504577+0000", 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0468999999999999e-05 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512615+0000", 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080376030000000008 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.512646+0000", 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1198000000000002e-05 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=131, reqid=osd.5.0:131, at_version=60'89, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.612762885000002, 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012770672, 2024-09-17T16:43:09.164 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505203+0000", 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.017e-06 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505226+0000", 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3224e-05 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505239+0000", 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-09-17T16:43:09.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505248+0000", 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9549999999999998e-06 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507065+0000", 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018174560000000001 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507074+0000", 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6589999999999996e-06 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517937+0000", 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010863268000000001 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517973+0000", 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5349000000000003e-05 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 60/34 ECSubWrite(tid=132, reqid=client.4553.0:429, at_version=60'21, trim_to=0'0, roll_forward_to=59'17))", 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.611861832999999, 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084385769999999992, 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.169 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506103+0000", 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506104+0000", 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506142+0000", 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7592000000000002e-05 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506156+0000", 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4269e-05 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506165+0000", 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9279999999999999e-06 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506988+0000", 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00082270100000000001 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.506998+0000", 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0118e-05 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514501+0000", 2024-09-17T16:43:09.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075035309999999999 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514542+0000", 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0519999999999998e-05 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 60/34 ECSubWrite(tid=145, reqid=osd.4.0:145, at_version=60'33, trim_to=0'0, roll_forward_to=59'31))", 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:43:09.173 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.608616548000001, 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083206809999999999, 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509348+0000", 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509349+0000", 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6100000000000002e-07 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509370+0000", 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1115e-05 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.175 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509381+0000", 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1476e-05 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509390+0000", 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509447+0000", 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6520000000000001e-05 2024-09-17T16:43:09.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.509457+0000", 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6889999999999999e-06 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517639+0000", 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081822079999999998 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517669+0000", 2024-09-17T16:43:09.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0182999999999999e-05 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 60/34 ECSubWrite(tid=145, reqid=osd.2.0:145, at_version=60'47, trim_to=0'0, roll_forward_to=59'43))", 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.604219407999999, 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01010516, 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.92e-07 2024-09-17T16:43:09.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513775+0000", 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8588000000000001e-05 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513792+0000", 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6854000000000002e-05 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513806+0000", 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4683e-05 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515751+0000", 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001944814 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515778+0000", 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7189999999999999e-05 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523825+0000", 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080462659999999998 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523851+0000", 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5973e-05 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=138, reqid=client.4553.0:432, at_version=60'91, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:43:09.182 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.603977002999997, 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099123409999999999, 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513989+0000", 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.82e-07 2024-09-17T16:43:09.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514171+0000", 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018223600000000001 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514183+0000", 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2313999999999999e-05 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514192+0000", 2024-09-17T16:43:09.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1849999999999993e-06 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514282+0000", 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0068999999999994e-05 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514294+0000", 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.203e-05 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523860+0000", 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095660139999999994 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523900+0000", 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9910999999999998e-05 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.187 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.662266031000001, 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015125326, 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.04e-07 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456064+0000", 2024-09-17T16:43:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036538299999999999 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456076+0000", 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456084+0000", 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7139999999999999e-06 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456157+0000", 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3034000000000006e-05 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456168+0000", 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0789e-05 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470774+0000", 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014606060000000001 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470824+0000", 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9960000000000003e-05 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 65/34 ECSubWrite(tid=70, reqid=client.4553.0:502, at_version=65'28, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.463074+0000", 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.654890484999999, 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0083920739999999994, 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.192 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463074+0000", 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463074+0000", 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463075+0000", 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8299999999999995e-07 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463734+0000", 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065840400000000002 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463759+0000", 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4941999999999999e-05 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463769+0000", 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0117e-05 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463832+0000", 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2834000000000002e-05 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.463844+0000", 2024-09-17T16:43:09.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2327000000000001e-05 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.471441+0000", 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075973450000000001 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.471467+0000", 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5222e-05 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.196 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.668279309999999, 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012786751000000001, 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449687+0000", 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-06 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.198 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449814+0000", 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012759199999999999 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449828+0000", 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3566e-05 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449852+0000", 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4219999999999999e-05 2024-09-17T16:43:09.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449921+0000", 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8886000000000004e-05 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449931+0000", 2024-09-17T16:43:09.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7529999999999996e-06 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462433+0000", 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012502233 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462472+0000", 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9307000000000002e-05 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.201 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 23.660078279, 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010065104, 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457888+0000", 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.04e-06 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458356+0000", 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046822600000000003 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458387+0000", 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892999999999997e-05 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458397+0000", 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9660000000000008e-06 2024-09-17T16:43:09.204 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458678+0000", 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028162199999999998 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458693+0000", 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4616e-05 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.467925+0000", 2024-09-17T16:43:09.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092320630000000004 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.467952+0000", 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6678000000000001e-05 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.529555+0000", 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 9.5884095889999994, 2024-09-17T16:43:09.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095323479999999995, 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529555+0000", 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529555+0000", 2024-09-17T16:43:09.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529556+0000", 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0240000000000001e-06 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529822+0000", 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026517100000000003 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529846+0000", 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4933999999999999e-05 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529856+0000", 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0009e-05 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529946+0000", 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9624999999999997e-05 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529956+0000", 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4690000000000003e-06 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539057+0000", 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091019289999999999 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539088+0000", 2024-09-17T16:43:09.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0187000000000001e-05 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 3.6482453660000003, 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027707544000000001, 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.211 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.09e-07 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471119+0000", 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013988729999999999 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471130+0000", 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1635e-05 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.213 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471136+0000", 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1260000000000003e-06 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471202+0000", 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5477999999999999e-05 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471214+0000", 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2539e-05 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497409+0000", 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026194978000000001 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497427+0000", 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7805999999999999e-05 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.215 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:09.217 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:43:09.218 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:09.215+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:09.318 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:09.316+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:09.319 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:09.319 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:09.319 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:09.319 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:09.328 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:43:09.419 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:09.418+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:09.451 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.8 to 1 (10000) 2024-09-17T16:43:09.456 INFO:tasks.rados.rados.0.smithi183.stdout:315: done (2 left) 2024-09-17T16:43:09.456 INFO:tasks.rados.rados.0.smithi183.stdout:316: read oid 17 snap 17 2024-09-17T16:43:09.456 INFO:tasks.rados.rados.0.smithi183.stdout:316: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:317: rollback oid 13 current snap is 32 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 13 to 24 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 4 to smithi18337221-6 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 5 to smithi18337221-6 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 6 to smithi18337221-6 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: finishing write tid 7 to smithi18337221-6 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: oid 6 updating version 0 to 47 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: oid 6 updating version 47 to 48 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: oid 6 version 48 is already newer than 45 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: oid 6 updating version 48 to 49 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: oid 6 updating version 49 to 50 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:310: oid 6 version 50 is already newer than 46 2024-09-17T16:43:09.457 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 6 v 50 (ObjNum 119 snap 32 seq_num 119) dirty exists 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:310: left oid 6 (ObjNum 119 snap 32 seq_num 119) 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:310: done (3 left) 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:318: read oid 8 snap 28 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:318: expect (ObjNum 104 snap 26 seq_num 104) 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:319: read oid 28 snap -1 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:319: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:320: copy_from oid 15 from oid 1 current snap is 32 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 1 to smithi18337221-37 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 2 to smithi18337221-37 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 3 to smithi18337221-37 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 4 to smithi18337221-37 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 5 to smithi18337221-37 2024-09-17T16:43:09.458 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 6 to smithi18337221-37 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: finishing write tid 7 to smithi18337221-37 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: oid 37 updating version 0 to 80 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: oid 37 updating version 80 to 85 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: oid 37 updating version 85 to 88 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: oid 37 version 88 is already newer than 86 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: oid 37 version 88 is already newer than 79 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: oid 37 version 88 is already newer than 87 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 37 v 88 (ObjNum 122 snap 32 seq_num 122) dirty exists 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: left oid 37 (ObjNum 122 snap 32 seq_num 122) 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:314: done (5 left) 2024-09-17T16:43:09.459 INFO:tasks.rados.rados.0.smithi183.stdout:321: setattr oid 5 current snap is 32 2024-09-17T16:43:09.460 INFO:tasks.rados.rados.0.smithi183.stdout:322: rmattr oid 6 current snap is 32 2024-09-17T16:43:09.460 INFO:tasks.rados.rados.0.smithi183.stdout:322: done (6 left) 2024-09-17T16:43:09.460 INFO:tasks.rados.rados.0.smithi183.stdout:323: rmattr oid 16 current snap is 32 2024-09-17T16:43:09.460 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 41 current snap is 32 2024-09-17T16:43:09.460 INFO:tasks.rados.rados.0.smithi183.stdout:324: seq_num 123 ranges {0=524288,524288=573440,1097728=688128,1785856=294912} 2024-09-17T16:43:09.462 INFO:tasks.rados.rados.0.smithi183.stdout:324: writing smithi18337221-41 from 0 to 524288 tid 1 2024-09-17T16:43:09.466 INFO:tasks.rados.rados.0.smithi183.stdout:324: writing smithi18337221-41 from 524288 to 1097728 tid 2 2024-09-17T16:43:09.471 INFO:tasks.rados.rados.0.smithi183.stdout:324: writing smithi18337221-41 from 1097728 to 1785856 tid 3 2024-09-17T16:43:09.473 INFO:tasks.rados.rados.0.smithi183.stdout:324: writing smithi18337221-41 from 1785856 to 2080768 tid 4 2024-09-17T16:43:09.473 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 7 current snap is 32 2024-09-17T16:43:09.473 INFO:tasks.rados.rados.0.smithi183.stdout:325: seq_num 124 ranges {212992=540672,753664=720896,1474560=786432,2260992=49152} 2024-09-17T16:43:09.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-17T16:43:09.479 INFO:tasks.rados.rados.0.smithi183.stdout:325: writing smithi18337221-7 from 212992 to 753664 tid 1 2024-09-17T16:43:09.480 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:09.480 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:09.480 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:09.480 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:09.481 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:09.483 INFO:tasks.rados.rados.0.smithi183.stdout:325: writing smithi18337221-7 from 753664 to 1474560 tid 2 2024-09-17T16:43:09.490 INFO:tasks.rados.rados.0.smithi183.stdout:325: writing smithi18337221-7 from 1474560 to 2260992 tid 3 2024-09-17T16:43:09.491 INFO:tasks.rados.rados.0.smithi183.stdout:325: writing smithi18337221-7 from 2260992 to 2310144 tid 4 2024-09-17T16:43:09.491 INFO:tasks.rados.rados.0.smithi183.stdout:326: snap_create 2024-09-17T16:43:09.491 INFO:tasks.rados.rados.0.smithi183.stdout:316: expect (ObjNum 16 snap 0 seq_num 16) 2024-09-17T16:43:09.491 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 17157 2024-09-17T16:43:09.495 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:43:09.497 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 274550 2024-09-17T16:43:09.497 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:09.501 INFO:tasks.rados.rados.0.smithi183.stdout:317: finishing rollback tid 0 to smithi18337221-13 2024-09-17T16:43:09.501 INFO:tasks.rados.rados.0.smithi183.stdout:317: finishing rollback tid 1 to smithi18337221-13 2024-09-17T16:43:09.501 INFO:tasks.rados.rados.0.smithi183.stdout:317: finishing rollback tid 2 to smithi18337221-13 2024-09-17T16:43:09.501 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 13 v 131 (ObjNum 84 snap 13 seq_num 84) dirty exists 2024-09-17T16:43:09.502 INFO:tasks.rados.rados.0.smithi183.stdout:318: expect (ObjNum 104 snap 26 seq_num 104) 2024-09-17T16:43:09.502 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:09.527 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:09.538 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:09.536+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:09.550 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:09.573 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 5 v 73 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-09-17T16:43:09.573 INFO:tasks.rados.rados.0.smithi183.stdout:319: expect (ObjNum 27 snap 0 seq_num 27) 2024-09-17T16:43:09.575 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 432647 2024-09-17T16:43:09.575 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:09.579 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 16 v 132 (ObjNum 68 snap 10 seq_num 68) dirty exists 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:320: finishing copy_from racing read to smithi18337221-15 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: finishing write tid 1 to smithi18337221-41 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:325: finishing write tid 1 to smithi18337221-7 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: finishing write tid 2 to smithi18337221-41 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: finishing write tid 3 to smithi18337221-41 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: finishing write tid 4 to smithi18337221-41 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: finishing write tid 5 to smithi18337221-41 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: finishing write tid 6 to smithi18337221-41 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: oid 41 updating version 0 to 66 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: oid 41 version 66 is already newer than 65 2024-09-17T16:43:09.584 INFO:tasks.rados.rados.0.smithi183.stdout:324: oid 41 version 66 is already newer than 64 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:324: oid 41 updating version 66 to 68 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:324: oid 41 version 68 is already newer than 67 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 41 v 68 (ObjNum 123 snap 32 seq_num 123) dirty exists 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:324: left oid 41 (ObjNum 123 snap 32 seq_num 123) 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:320: finishing copy_from to smithi18337221-15 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 192 (ObjNum 113 snap 29 seq_num 113) dirty exists 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: finishing write tid 2 to smithi18337221-7 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: finishing write tid 3 to smithi18337221-7 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: finishing write tid 4 to smithi18337221-7 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: finishing write tid 5 to smithi18337221-7 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: finishing write tid 6 to smithi18337221-7 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: oid 7 updating version 0 to 45 2024-09-17T16:43:09.585 INFO:tasks.rados.rados.0.smithi183.stdout:325: oid 7 version 45 is already newer than 44 2024-09-17T16:43:09.586 INFO:tasks.rados.rados.0.smithi183.stdout:325: oid 7 version 45 is already newer than 42 2024-09-17T16:43:09.586 INFO:tasks.rados.rados.0.smithi183.stdout:325: oid 7 version 45 is already newer than 43 2024-09-17T16:43:09.586 INFO:tasks.rados.rados.0.smithi183.stdout:325: oid 7 updating version 45 to 46 2024-09-17T16:43:09.586 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 7 v 46 (ObjNum 124 snap 32 seq_num 124) dirty exists 2024-09-17T16:43:09.586 INFO:tasks.rados.rados.0.smithi183.stdout:325: left oid 7 (ObjNum 124 snap 32 seq_num 124) 2024-09-17T16:43:09.602 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:09.602 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:09.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.088178687000003, 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013863510000000001, 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:09.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513354+0000", 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001750883 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513367+0000", 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3108999999999999e-05 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513376+0000", 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8969999999999997e-06 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513451+0000", 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513461+0000", 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0023999999999999e-05 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525431+0000", 2024-09-17T16:43:09.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011969377 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525467+0000", 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5988000000000002e-05 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.607 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=93, reqid=osd.5.0:93, at_version=55'60, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.114781473000001, 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099079770000000001, 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485001+0000", 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485013+0000", 2024-09-17T16:43:09.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2393e-05 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485021+0000", 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9230000000000002e-06 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485026+0000", 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0980000000000001e-06 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485078+0000", 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1650999999999997e-05 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485087+0000", 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9039999999999998e-06 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494869+0000", 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097825159999999998 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494908+0000", 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.909e-05 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.9s6 55/34 ECSubWrite(tid=60, reqid=osd.14.0:60, at_version=55'29, trim_to=0'0, roll_forward_to=53'25))", 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.114305375000001, 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091203440000000007, 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.612 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485477+0000", 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6300000000000005e-07 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485497+0000", 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0041e-05 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.614 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.615 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485509+0000", 2024-09-17T16:43:09.615 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1668000000000001e-05 2024-09-17T16:43:09.615 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.615 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485517+0000", 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.841e-06 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485572+0000", 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5325999999999998e-05 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485582+0000", 2024-09-17T16:43:09.616 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0105000000000001e-05 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494561+0000", 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089786810000000005 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494597+0000", 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6019000000000002e-05 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.113205293, 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018742894999999999, 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.618 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.619 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486599+0000", 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1361000000000001e-05 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486608+0000", 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.620 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486616+0000", 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.537e-06 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486743+0000", 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127188 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486748+0000", 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4489999999999998e-06 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.621 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505277+0000", 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018528340000000001 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505320+0000", 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2834999999999999e-05 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.622 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=122, reqid=osd.4.0:119, at_version=0'0, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.112696761000002, 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013009134, 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:43:09.623 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487086+0000", 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5099999999999999e-07 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.624 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487097+0000", 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487113+0000", 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5336e-05 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487121+0000", 2024-09-17T16:43:09.625 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487184+0000", 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3207999999999995e-05 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487195+0000", 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1467999999999999e-05 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.626 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499908+0000", 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012713089 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500094+0000", 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000185847 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.627 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 55/34 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=55'24, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.109871634000001, 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010075503, 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.628 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1899999999999999e-07 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489931+0000", 2024-09-17T16:43:09.629 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-05 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489946+0000", 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5729000000000001e-05 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489954+0000", 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2549999999999997e-06 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.630 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490014+0000", 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9242e-05 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490024+0000", 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.004e-05 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499913+0000", 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098893910000000008 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.631 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499986+0000", 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2607000000000005e-05 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=124, reqid=client.4553.0:351, at_version=55'27, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.106428813999997, 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090505629999999993, 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.632 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493353+0000", 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.633 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493354+0000", 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7199999999999997e-07 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493765+0000", 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00041148500000000001 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493776+0000", 2024-09-17T16:43:09.634 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1021e-05 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493784+0000", 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5569999999999998e-06 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493830+0000", 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5838999999999999e-05 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.635 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493836+0000", 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.993e-06 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502370+0000", 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085342400000000002 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502404+0000", 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3556000000000002e-05 2024-09-17T16:43:09.636 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 41.100898602000001, 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011728341, 2024-09-17T16:43:09.637 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.638 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498884+0000", 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6400000000000001e-07 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499236+0000", 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035160500000000001 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.639 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499249+0000", 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3454e-05 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499256+0000", 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.905e-06 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499318+0000", 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2067000000000001e-05 2024-09-17T16:43:09.640 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499329+0000", 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1131000000000001e-05 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510579+0000", 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011250135 2024-09-17T16:43:09.641 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510612+0000", 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2280000000000003e-05 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 36.081209645000001, 2024-09-17T16:43:09.642 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011339162, 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:43:09.643 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518573+0000", 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518909+0000", 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033576100000000001 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.644 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518925+0000", 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5661000000000001e-05 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518933+0000", 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4209999999999995e-06 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519013+0000", 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0346000000000006e-05 2024-09-17T16:43:09.645 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519023+0000", 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0212e-05 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529853+0000", 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010829221 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529911+0000", 2024-09-17T16:43:09.646 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8709999999999999e-05 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.148562542999997, 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016876885000000001, 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.647 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.648 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451220+0000", 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7499999999999999e-07 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451677+0000", 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045773500000000002 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451691+0000", 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3679000000000001e-05 2024-09-17T16:43:09.649 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451699+0000", 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0679999999999997e-06 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451773+0000", 2024-09-17T16:43:09.650 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4064000000000001e-05 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451783+0000", 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9259999999999995e-06 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468036+0000", 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016253360000000001 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.651 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468096+0000", 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9877999999999998e-05 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 62/34 ECSubWrite(tid=178, reqid=osd.4.0:178, at_version=62'26, trim_to=0'0, roll_forward_to=61'24))", 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.145370075999999, 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092270379999999999, 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.652 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.653 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454412+0000", 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1e-07 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454436+0000", 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3799999999999999e-05 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.654 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454444+0000", 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3459999999999994e-06 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454449+0000", 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0939999999999998e-06 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454497+0000", 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7525000000000003e-05 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.655 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454502+0000", 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4299999999999997e-06 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463615+0000", 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091123920000000004 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463639+0000", 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4141000000000001e-05 2024-09-17T16:43:09.656 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 62/34 ECSubWrite(tid=177, reqid=osd.4.0:177, at_version=62'41, trim_to=0'0, roll_forward_to=61'39))", 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.145255112000001, 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090665380000000007, 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.657 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454527+0000", 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7e-07 2024-09-17T16:43:09.658 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454543+0000", 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5809999999999999e-05 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454551+0000", 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7559999999999999e-06 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.659 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454557+0000", 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4609999999999996e-06 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454604+0000", 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6408e-05 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.454611+0000", 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4379999999999998e-06 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.660 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463555+0000", 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089443869999999998 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.463593+0000", 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7907999999999997e-05 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.661 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=161, reqid=osd.5.0:161, at_version=62'106, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.142273207000002, 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010613879999999999, 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.662 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.37e-07 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457532+0000", 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2344000000000002e-05 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.663 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457542+0000", 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0698e-05 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457550+0000", 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9289999999999998e-06 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458149+0000", 2024-09-17T16:43:09.664 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059811399999999996 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458387+0000", 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238247 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468103+0000", 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097161869999999994 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.665 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468123+0000", 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9624e-05 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=162, reqid=osd.5.0:162, at_version=62'108, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.140797022999998, 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091647150000000004, 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.666 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458985+0000", 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.667 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458986+0000", 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7800000000000001e-07 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459007+0000", 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1586999999999998e-05 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459017+0000", 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0142999999999999e-05 2024-09-17T16:43:09.668 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459026+0000", 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8200000000000003e-06 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459585+0000", 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055877100000000001 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.459593+0000", 2024-09-17T16:43:09.669 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1519999999999992e-06 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468128+0000", 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085349339999999992 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468150+0000", 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1630000000000001e-05 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.670 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.139471813, 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094236489999999992, 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:43:09.671 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460311+0000", 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5899999999999996e-07 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.672 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460665+0000", 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035421500000000001 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460681+0000", 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5739e-05 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460689+0000", 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3340000000000002e-06 2024-09-17T16:43:09.673 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464005+0000", 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033161390000000001 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464015+0000", 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0242e-05 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469702+0000", 2024-09-17T16:43:09.674 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056865780000000003 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469734+0000", 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1843e-05 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:09.675 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.145488452999999, 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013750108, 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.676 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454294+0000", 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6e-07 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081548199999999997 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.677 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455123+0000", 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4392999999999999e-05 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455130+0000", 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6800000000000004e-06 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455201+0000", 2024-09-17T16:43:09.678 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1088999999999996e-05 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455214+0000", 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2923e-05 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.467980+0000", 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012766136000000001 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.679 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.468044+0000", 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3244999999999995e-05 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.138076559, 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098962259999999993, 2024-09-17T16:43:09.680 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:43:09.681 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461706+0000", 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7800000000000001e-07 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461987+0000", 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028039999999999999 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.682 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461998+0000", 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1080000000000001e-05 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462005+0000", 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3799999999999996e-06 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462079+0000", 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3937999999999996e-05 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462087+0000", 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1270000000000003e-06 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.471578+0000", 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094905340000000001 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.471602+0000", 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3989e-05 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 86/77 ECSubWrite(tid=314, reqid=client.4553.0:694, at_version=86'68, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.521724+0000", 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.078057497, 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014249914000000001, 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.685 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521724+0000", 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521724+0000", 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521725+0000", 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1800000000000002e-07 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522508+0000", 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078327500000000005 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522533+0000", 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522547+0000", 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4154e-05 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522643+0000", 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5835000000000007e-05 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522654+0000", 2024-09-17T16:43:09.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1477e-05 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.535936+0000", 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013282001 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.535974+0000", 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8216000000000001e-05 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.529803+0000", 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.069979224000001, 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097265939999999999, 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529803+0000", 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529803+0000", 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529805+0000", 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.968e-06 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530434+0000", 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062917400000000003 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530453+0000", 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9321999999999999e-05 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530464+0000", 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0380000000000001e-05 2024-09-17T16:43:09.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530577+0000", 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011335199999999999 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530593+0000", 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5688999999999998e-05 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539494+0000", 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089014420000000007 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539529+0000", 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5267e-05 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:09.694 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:05.469888+0000", 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.1298941520000003, 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017642463000000001, 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469888+0000", 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:09.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469888+0000", 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469889+0000", 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472597+0000", 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00270783 2024-09-17T16:43:09.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472621+0000", 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4241999999999999e-05 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472633+0000", 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.253e-05 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:09.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472704+0000", 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0591000000000002e-05 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472715+0000", 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1457999999999999e-05 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.487488+0000", 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014772815999999999 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:09.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.487530+0000", 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2063e-05 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:09.699 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:09.701 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:43:09.701 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:09.699+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:09.801 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:09.799+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:09.845 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:09.845 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:09.845 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:09.845 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:09.854 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:43:09.903 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:09.900+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:09.957 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:09.957 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:09.957 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:09.957 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:09.958 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:09.964 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:43:10.003 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:10.001+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:10.103 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:10.101+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:195 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:10.108 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.627625055000003, 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01148677, 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 195 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477777+0000", 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6400000000000002e-07 2024-09-17T16:43:10.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477782+0000", 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0939999999999998e-06 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477789+0000", 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477795+0000", 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5849999999999999e-06 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000159579 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477958+0000", 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9879999999999998e-06 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480631+0000", 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0026728429999999998 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480694+0000", 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2594000000000004e-05 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.489263+0000", 2024-09-17T16:43:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0085697580000000002 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:196 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~311296,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.627567202999998, 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011896488, 2024-09-17T16:43:10.114 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 196 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:43:10.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477835+0000", 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477838+0000", 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9239999999999999e-06 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477844+0000", 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.891e-06 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477850+0000", 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4189999999999999e-06 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000145926 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.478002+0000", 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2090000000000002e-06 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.480989+0000", 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002986542 2024-09-17T16:43:10.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.481054+0000", 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5227000000000004e-05 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.489731+0000", 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086769480000000003 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.8s4 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.614870154999998, 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013315062000000001, 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:43:10.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490532+0000", 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490758+0000", 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022558800000000001 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490774+0000", 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6350000000000001e-05 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490784+0000", 2024-09-17T16:43:10.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5750000000000007e-06 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490854+0000", 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0339000000000005e-05 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.490864+0000", 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6660000000000003e-06 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503808+0000", 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012944073 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.503847+0000", 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8612999999999998e-05 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.124 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:251 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~622592] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.600299296999999, 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013520938, 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 251 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505102+0000", 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.505104+0000", 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8870000000000001e-06 2024-09-17T16:43:10.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506163+0000", 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010585 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506177+0000", 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4022999999999999e-05 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506185+0000", 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7209999999999994e-06 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506254+0000", 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9264000000000006e-05 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.506349+0000", 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4704999999999995e-05 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507791+0000", 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014424469999999999 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517101+0000", 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093103430000000004 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518539+0000", 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00143816 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518623+0000", 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3887999999999994e-05 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:252 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~376832] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:10.130 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.598246543999998, 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014876686, 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 252 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507156+0000", 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2309999999999999e-06 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507825+0000", 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066852899999999995 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507839+0000", 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4260999999999999e-05 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507848+0000", 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9660000000000002e-06 2024-09-17T16:43:10.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513602+0000", 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057539069999999999 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513711+0000", 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010927199999999999 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.514507+0000", 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079574400000000003 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518107+0000", 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035998129999999999 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.521980+0000", 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038731780000000001 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522032+0000", 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1785e-05 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:253 3.9s0 3:97a3b59a:::smithi18337221-19:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.597529876999999, 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01439824, 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.136 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 253 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.137 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507873+0000", 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1319999999999999e-06 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507897+0000", 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.44e-05 2024-09-17T16:43:10.138 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507905+0000", 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9980000000000003e-06 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507913+0000", 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2849999999999997e-06 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.139 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517178+0000", 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092654350000000007 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517280+0000", 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102011 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517762+0000", 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048150100000000001 2024-09-17T16:43:10.140 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518681+0000", 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091987099999999995 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522146+0000", 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003464895 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.141 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522270+0000", 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123712 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:254 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.597477232999999, 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014640482, 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.142 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 254 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.143 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.144 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507925+0000", 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4700000000000001e-07 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.145 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507927+0000", 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0789999999999999e-06 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507932+0000", 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8400000000000002e-06 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507935+0000", 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3380000000000001e-06 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.146 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518013+0000", 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077697 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518096+0000", 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2707000000000006e-05 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522552+0000", 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044558430000000001 2024-09-17T16:43:10.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522565+0000", 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3431000000000001e-05 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as4 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 50.593707086999999, 2024-09-17T16:43:10.148 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011705553, 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.149 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511695+0000", 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3700000000000001e-07 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512098+0000", 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00040260399999999998 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.150 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512112+0000", 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4521999999999999e-05 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512121+0000", 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.969e-06 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512181+0000", 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9756000000000002e-05 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.151 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512191+0000", 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0351e-05 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523363+0000", 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011172059 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.523400+0000", 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6854999999999999e-05 2024-09-17T16:43:10.152 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:306 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.654399058000003, 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011720622999999999, 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.153 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 306 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:43:10.154 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451003+0000", 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4200000000000002e-07 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451005+0000", 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8729999999999999e-06 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.155 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451008+0000", 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5949999999999999e-06 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451011+0000", 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.072e-06 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451218+0000", 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00020686399999999999 2024-09-17T16:43:10.156 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451222+0000", 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.444e-06 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461055+0000", 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.009833385 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461120+0000", 2024-09-17T16:43:10.157 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5279999999999998e-05 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.462723+0000", 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016028679999999999 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:307 3.9s0 3:976fae50:::smithi18337221-18:9 [read 0~294912,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e51)", 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:43:10.158 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 45.654386373000001, 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012102027, 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 307 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.159 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451015+0000", 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451016+0000", 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3999999999999998e-07 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.160 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451017+0000", 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6309999999999999e-06 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451021+0000", 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4170000000000001e-06 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451024+0000", 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9019999999999999e-06 2024-09-17T16:43:10.161 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451255+0000", 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00023170600000000001 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.451262+0000", 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4470000000000003e-06 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.162 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461381+0000", 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010119067000000001 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.461453+0000", 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2119999999999994e-05 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.163 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:24.463117+0000", 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001664497 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as4 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.651091241, 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016135330999999999, 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.164 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.165 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454311+0000", 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454926+0000", 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061552000000000004 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454943+0000", 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6433999999999999e-05 2024-09-17T16:43:10.166 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454970+0000", 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7345999999999999e-05 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455041+0000", 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1317999999999997e-05 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455050+0000", 2024-09-17T16:43:10.167 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4160000000000004e-06 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470410+0000", 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015359937000000001 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470446+0000", 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6010999999999998e-05 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.168 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:655 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~655360] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.653310+0000", 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.452091558999999, 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018562510000000001, 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.169 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 655 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653310+0000", 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653310+0000", 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.170 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653312+0000", 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2630000000000002e-06 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653983+0000", 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067078999999999999 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654005+0000", 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1562000000000001e-05 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.171 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654014+0000", 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654076+0000", 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1883000000000004e-05 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654150+0000", 2024-09-17T16:43:10.172 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4365999999999999e-05 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654845+0000", 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069466000000000005 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.665740+0000", 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010895414000000001 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.173 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671790+0000", 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060495820000000004 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671873+0000", 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2776999999999997e-05 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.174 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:656 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~606208] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.656634+0000", 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.448767551, 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017061376, 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 656 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.175 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.656634+0000", 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.656634+0000", 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.656635+0000", 2024-09-17T16:43:10.176 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2640000000000001e-06 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.657191+0000", 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055534099999999999 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.657203+0000", 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2454e-05 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.177 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.657209+0000", 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8420000000000001e-06 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.661005+0000", 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00379612 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.661128+0000", 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000122855 2024-09-17T16:43:10.178 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.661911+0000", 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078326000000000003 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671895+0000", 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099834620000000002 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673651+0000", 2024-09-17T16:43:10.179 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017562140000000001 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673696+0000", 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4564000000000002e-05 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:657 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~475136] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:10.180 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.659429+0000", 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.445972512999999, 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015975145999999999, 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 657 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.181 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659429+0000", 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659429+0000", 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659430+0000", 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.182 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659803+0000", 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037236799999999998 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659814+0000", 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1783999999999999e-05 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659820+0000", 2024-09-17T16:43:10.183 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.857e-06 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.665923+0000", 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061033019999999997 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.666011+0000", 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7272000000000001e-05 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.184 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.666850+0000", 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083894199999999996 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671986+0000", 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051360570000000003 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.675363+0000", 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033769749999999999 2024-09-17T16:43:10.185 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.675404+0000", 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1659000000000002e-05 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:658 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~81920] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.659899+0000", 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.445502263, 2024-09-17T16:43:10.186 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684350000000001, 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 658 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659899+0000", 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.187 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659899+0000", 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659900+0000", 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1699999999999997e-07 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.188 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659975+0000", 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4841999999999999e-05 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659983+0000", 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6769999999999995e-06 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659986+0000", 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7050000000000001e-06 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.189 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.670389+0000", 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010402575000000001 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.670497+0000", 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107958 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.670978+0000", 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048103099999999998 2024-09-17T16:43:10.190 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672041+0000", 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010632300000000001 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676446+0000", 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044043939999999998 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676584+0000", 2024-09-17T16:43:10.191 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138121 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:659 3.0s0 3:0cb75d13:::smithi18337221-6:head [setxattr _header (56) in=7b] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.659994+0000", 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.445407243, 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016805785, 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.192 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 659 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659994+0000", 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659994+0000", 2024-09-17T16:43:10.193 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659995+0000", 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.08e-07 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659997+0000", 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7120000000000001e-06 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.194 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660001+0000", 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3270000000000002e-06 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660004+0000", 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.729e-06 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672198+0000", 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012194023 2024-09-17T16:43:10.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672284+0000", 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6810000000000004e-05 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672696+0000", 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000411884 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.196 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673300+0000", 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000604121 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676707+0000", 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034068530000000001 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676800+0000", 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2917999999999994e-05 2024-09-17T16:43:10.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:660 3.0s0 3:0cb75d13:::smithi18337221-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.660007+0000", 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.445394256, 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017680199000000001, 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:10.198 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 660 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660007+0000", 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660007+0000", 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.199 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660008+0000", 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5699999999999999e-07 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660009+0000", 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.331e-06 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660013+0000", 2024-09-17T16:43:10.200 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4999999999999999e-06 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660015+0000", 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7219999999999999e-06 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673337+0000", 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013321665999999999 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.201 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673428+0000", 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1176999999999998e-05 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.677183+0000", 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003754715 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.677236+0000", 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.287e-05 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.202 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.677688+0000", 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045196100000000002 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s6 86/77 ECSubWrite(tid=314, reqid=client.4553.0:694, at_version=86'68, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.521686+0000", 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 10.583715407, 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018258262000000001, 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.203 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.204 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.204 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.204 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.204 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.204 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521686+0000", 2024-09-17T16:43:10.204 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521686+0000", 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521687+0000", 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1900000000000001e-07 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.205 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522744+0000", 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010568439999999999 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522764+0000", 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9545e-05 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522773+0000", 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6700000000000006e-06 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.206 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522863+0000", 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0087000000000007e-05 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522874+0000", 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0761000000000001e-05 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539894+0000", 2024-09-17T16:43:10.207 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017019854000000001 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539945+0000", 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0682e-05 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s6 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:05.469892+0000", 2024-09-17T16:43:10.208 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.6355093140000001, 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027143515, 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469892+0000", 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.209 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469892+0000", 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469893+0000", 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7800000000000001e-07 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472671+0000", 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002778151 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.210 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472692+0000", 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0194999999999999e-05 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472701+0000", 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472774+0000", 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2841000000000003e-05 2024-09-17T16:43:10.211 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472786+0000", 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2362e-05 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497002+0000", 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024216044999999999 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497036+0000", 2024-09-17T16:43:10.212 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3843000000000001e-05 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s6 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:09.479842+0000", 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 0.62555992500000002, 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019586619, 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:10.213 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479842+0000", 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479842+0000", 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479843+0000", 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.92e-07 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481704+0000", 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001861779 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481719+0000", 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4143e-05 2024-09-17T16:43:10.215 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481726+0000", 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9470000000000003e-06 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481793+0000", 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7001000000000004e-05 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.216 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481803+0000", 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8980000000000008e-06 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.499400+0000", 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01759635 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.499428+0000", 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8708999999999999e-05 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.217 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.218 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:10.218 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:10.218 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:10.219 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:43:10.220 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:10.217+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:10.320 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:10.318+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:10.328 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:10.328 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:10.328 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:10.328 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:10.336 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:43:10.420 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:10.419+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:10.440 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:10.440 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:10.440 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:10.440 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:10.440 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:10.446 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.9 to 1 (10000) 2024-09-17T16:43:10.448 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:43:10.450 INFO:tasks.rados.rados.0.smithi183.stdout:316: done (9 left) 2024-09-17T16:43:10.450 INFO:tasks.rados.rados.0.smithi183.stdout:317: done (8 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:318: done (7 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:319: done (6 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:320: done (5 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:321: done (4 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:323: done (3 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:324: done (2 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:325: done (1 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:326: done (0 left) 2024-09-17T16:43:10.451 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 34 current snap is 33 2024-09-17T16:43:10.452 INFO:tasks.rados.rados.0.smithi183.stdout:327: seq_num 125 ranges {557056=557056,1114112=475136,1589248=507904,2097152=475136,2572288=98304} 2024-09-17T16:43:10.455 INFO:tasks.rados.rados.0.smithi183.stdout:327: writing smithi18337221-34 from 557056 to 1114112 tid 1 2024-09-17T16:43:10.458 INFO:tasks.rados.rados.0.smithi183.stdout:327: writing smithi18337221-34 from 1114112 to 1589248 tid 2 2024-09-17T16:43:10.461 INFO:tasks.rados.rados.0.smithi183.stdout:327: writing smithi18337221-34 from 1589248 to 2097152 tid 3 2024-09-17T16:43:10.464 INFO:tasks.rados.rados.0.smithi183.stdout:327: writing smithi18337221-34 from 2097152 to 2572288 tid 4 2024-09-17T16:43:10.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-17T16:43:10.467 INFO:tasks.rados.rados.0.smithi183.stdout:327: writing smithi18337221-34 from 2572288 to 2670592 tid 5 2024-09-17T16:43:10.467 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 24 current snap is 33 2024-09-17T16:43:10.467 INFO:tasks.rados.rados.0.smithi183.stdout:328: seq_num 126 ranges {0=573440,573440=622592,1196032=622592,1818624=311296} 2024-09-17T16:43:10.468 INFO:tasks.rados.rados.0.smithi183.stdout:328: writing smithi18337221-24 from 0 to 573440 tid 1 2024-09-17T16:43:10.472 INFO:tasks.rados.rados.0.smithi183.stdout:328: writing smithi18337221-24 from 573440 to 1196032 tid 2 2024-09-17T16:43:10.476 INFO:tasks.rados.rados.0.smithi183.stdout:328: writing smithi18337221-24 from 1196032 to 1818624 tid 3 2024-09-17T16:43:10.478 INFO:tasks.rados.rados.0.smithi183.stdout:328: writing smithi18337221-24 from 1818624 to 2129920 tid 4 2024-09-17T16:43:10.478 INFO:tasks.rados.rados.0.smithi183.stdout:329: read oid 21 snap -1 2024-09-17T16:43:10.478 INFO:tasks.rados.rados.0.smithi183.stdout:329: expect (ObjNum 20 snap 0 seq_num 20) 2024-09-17T16:43:10.479 INFO:tasks.rados.rados.0.smithi183.stdout:330: snap_create 2024-09-17T16:43:10.479 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 1 to smithi18337221-34 2024-09-17T16:43:10.479 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 2 to smithi18337221-34 2024-09-17T16:43:10.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:43:10.484 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 3 to smithi18337221-34 2024-09-17T16:43:10.484 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 4 to smithi18337221-34 2024-09-17T16:43:10.484 INFO:tasks.rados.rados.0.smithi183.stdout:328: finishing write tid 1 to smithi18337221-24 2024-09-17T16:43:10.484 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 5 to smithi18337221-34 2024-09-17T16:43:10.485 INFO:tasks.rados.rados.0.smithi183.stdout:329: expect (ObjNum 20 snap 0 seq_num 20) 2024-09-17T16:43:10.485 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:10.489 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 47793 2024-09-17T16:43:10.494 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 311177 2024-09-17T16:43:10.496 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 6 to smithi18337221-34 2024-09-17T16:43:10.496 INFO:tasks.rados.rados.0.smithi183.stdout:327: finishing write tid 7 to smithi18337221-34 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: oid 34 updating version 0 to 121 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: oid 34 version 121 is already newer than 119 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: oid 34 version 121 is already newer than 118 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: oid 34 updating version 121 to 122 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: oid 34 version 122 is already newer than 117 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: oid 34 version 122 is already newer than 120 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 34 v 122 (ObjNum 125 snap 33 seq_num 125) dirty exists 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:327: left oid 34 (ObjNum 125 snap 33 seq_num 125) 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:328: finishing write tid 2 to smithi18337221-24 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:328: finishing write tid 3 to smithi18337221-24 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:328: finishing write tid 4 to smithi18337221-24 2024-09-17T16:43:10.497 INFO:tasks.rados.rados.0.smithi183.stdout:328: finishing write tid 5 to smithi18337221-24 2024-09-17T16:43:10.498 INFO:tasks.rados.rados.0.smithi183.stdout:328: finishing write tid 6 to smithi18337221-24 2024-09-17T16:43:10.498 INFO:tasks.rados.rados.0.smithi183.stdout:328: oid 24 updating version 0 to 139 2024-09-17T16:43:10.498 INFO:tasks.rados.rados.0.smithi183.stdout:328: oid 24 version 139 is already newer than 136 2024-09-17T16:43:10.498 INFO:tasks.rados.rados.0.smithi183.stdout:328: oid 24 version 139 is already newer than 138 2024-09-17T16:43:10.498 INFO:tasks.rados.rados.0.smithi183.stdout:328: oid 24 version 139 is already newer than 135 2024-09-17T16:43:10.498 INFO:tasks.rados.rados.0.smithi183.stdout:328: oid 24 version 139 is already newer than 137 2024-09-17T16:43:10.499 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 24 v 139 (ObjNum 126 snap 33 seq_num 126) dirty exists 2024-09-17T16:43:10.499 INFO:tasks.rados.rados.0.smithi183.stdout:328: left oid 24 (ObjNum 126 snap 33 seq_num 126) 2024-09-17T16:43:10.522 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:10.519+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:10.559 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:10.559 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:10.559 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.074307824000002, 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074612999999999997, 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.560 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482439+0000", 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7199999999999998e-07 2024-09-17T16:43:10.561 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482462+0000", 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2668e-05 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482473+0000", 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.562 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482481+0000", 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6130000000000004e-06 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486671+0000", 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041899479999999998 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486680+0000", 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8869999999999998e-06 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.563 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489834+0000", 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031540069999999999 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489899+0000", 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5050999999999998e-05 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.564 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:43:10.565 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:10.565 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.073597788000001, 2024-09-17T16:43:10.565 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008086981, 2024-09-17T16:43:10.565 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.565 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.566 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483149+0000", 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483164+0000", 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.523e-05 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483175+0000", 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0876999999999999e-05 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.568 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483181+0000", 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3029999999999996e-06 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488038+0000", 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048566149999999999 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488047+0000", 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3070000000000008e-06 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491189+0000", 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031416790000000001 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491235+0000", 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6241e-05 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.570 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.064159076999999, 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013185944, 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.571 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492588+0000", 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7600000000000006e-07 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493009+0000", 2024-09-17T16:43:10.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042131299999999998 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493025+0000", 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5605000000000001e-05 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493033+0000", 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.32e-06 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1038000000000006e-05 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493124+0000", 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4909999999999994e-06 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.574 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505727+0000", 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012603346 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505773+0000", 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5855000000000001e-05 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.058210115000001, 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071885259999999998, 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498537+0000", 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498559+0000", 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2444000000000001e-05 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498576+0000", 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7067000000000001e-05 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0920000000000004e-06 2024-09-17T16:43:10.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498675+0000", 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9314999999999994e-05 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498682+0000", 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8699999999999992e-06 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505669+0000", 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069863959999999998 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505724+0000", 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5414999999999997e-05 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 42.051944175000003, 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083741470000000002, 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.581 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504803+0000", 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9100000000000002e-07 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505695+0000", 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089272400000000001 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505712+0000", 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6320999999999998e-05 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505720+0000", 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6780000000000006e-06 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505787+0000", 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6303000000000005e-05 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505797+0000", 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0455000000000001e-05 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513105+0000", 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007307717 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513176+0000", 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1057999999999996e-05 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.038357535999999, 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016246389999999999, 2024-09-17T16:43:10.585 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518389+0000", 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.51e-07 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518980+0000", 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059100999999999999 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519003+0000", 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2819999999999998e-05 2024-09-17T16:43:10.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519012+0000", 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519183+0000", 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017095399999999999 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519194+0000", 2024-09-17T16:43:10.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.102e-05 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534599+0000", 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015404927000000001 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534635+0000", 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5364000000000002e-05 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.589 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.030622166000001, 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085642229999999993, 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526125+0000", 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999999e-07 2024-09-17T16:43:10.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526311+0000", 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018657999999999999 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526341+0000", 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9788999999999999e-05 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526352+0000", 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1379999999999999e-05 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527177+0000", 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082429900000000002 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527187+0000", 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.06e-05 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534665+0000", 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074776570000000004 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534688+0000", 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2994999999999999e-05 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=150, reqid=osd.5.0:150, at_version=61'95, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:43:10.594 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.046125566999997, 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071525119999999998, 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510621+0000", 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4099999999999997e-07 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510647+0000", 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5749999999999999e-05 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510664+0000", 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7388999999999999e-05 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510674+0000", 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0011e-05 2024-09-17T16:43:10.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510769+0000", 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4370999999999995e-05 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510779+0000", 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0302999999999999e-05 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517731+0000", 2024-09-17T16:43:10.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069523679999999996 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517773+0000", 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1378999999999998e-05 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=151, reqid=client.4553.0:467, at_version=61'97, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.043815023999997, 2024-09-17T16:43:10.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0096697429999999997, 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512932+0000", 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512962+0000", 2024-09-17T16:43:10.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0382000000000002e-05 2024-09-17T16:43:10.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512978+0000", 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6013000000000001e-05 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512997+0000", 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8839999999999999e-05 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513153+0000", 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000155969 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513163+0000", 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.031e-05 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522566+0000", 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094027599999999996 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522601+0000", 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4542000000000002e-05 2024-09-17T16:43:10.604 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.100428159, 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017286182000000001, 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.605 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0900000000000001e-07 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457450+0000", 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011316200000000001 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457466+0000", 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6240999999999999e-05 2024-09-17T16:43:10.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457479+0000", 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2836e-05 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457584+0000", 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000105493 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457594+0000", 2024-09-17T16:43:10.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6059999999999992e-06 2024-09-17T16:43:10.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473552+0000", 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015957846000000001 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473604+0000", 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2330999999999998e-05 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.095351193999999, 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012610367000000001, 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461396+0000", 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461793+0000", 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039774400000000001 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461808+0000", 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4939999999999999e-05 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461849+0000", 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0674999999999999e-05 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.462239+0000", 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038960600000000002 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.462251+0000", 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2116999999999999e-05 2024-09-17T16:43:10.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473961+0000", 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011710010999999999 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474005+0000", 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4308999999999999e-05 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.090543805999999, 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079189910000000002, 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:10.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466203+0000", 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.291e-06 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466601+0000", 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039756699999999998 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466621+0000", 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0288999999999998e-05 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466656+0000", 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4671000000000001e-05 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.468123+0000", 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014669419999999999 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.468133+0000", 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6849999999999996e-06 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474092+0000", 2024-09-17T16:43:10.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005959509 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474121+0000", 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9037e-05 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 82/77 ECSubWrite(tid=100, reqid=client.4553.0:656, at_version=82'22, trim_to=0'0, roll_forward_to=78'19))", 2024-09-17T16:43:10.620 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.894739997, 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010050554, 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662007+0000", 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5999999999999991e-07 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662470+0000", 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046351299999999998 2024-09-17T16:43:10.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662481+0000", 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0638999999999999e-05 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662489+0000", 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0460000000000006e-06 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662551+0000", 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2383000000000002e-05 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662563+0000", 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1483e-05 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.672026+0000", 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094634090000000008 2024-09-17T16:43:10.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.672056+0000", 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0120999999999998e-05 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.3s3 96/77 ECSubWrite(tid=70, reqid=osd.15.0:70, at_version=96'44, trim_to=0'0, roll_forward_to=95'42))", 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.091809206, 2024-09-17T16:43:10.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080907759999999992, 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:10.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9299999999999999e-07 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464963+0000", 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6245999999999999e-05 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464976+0000", 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2801e-05 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464997+0000", 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0381999999999999e-05 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465087+0000", 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0882000000000002e-05 2024-09-17T16:43:10.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465099+0000", 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2065000000000001e-05 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472973+0000", 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078740049999999999 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.473027+0000", 2024-09-17T16:43:10.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4002000000000002e-05 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.0915772269999999, 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019745841, 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.630 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6499999999999998e-07 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466510+0000", 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001340489 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466529+0000", 2024-09-17T16:43:10.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9086999999999999e-05 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466540+0000", 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0669000000000001e-05 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466609+0000", 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9511000000000006e-05 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466619+0000", 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0059e-05 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484852+0000", 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018232578999999999 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484915+0000", 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2681999999999994e-05 2024-09-17T16:43:10.634 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.0860598210000001, 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014254615, 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470687+0000", 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1200000000000001e-06 2024-09-17T16:43:10.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472739+0000", 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0020515249999999998 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472755+0000", 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6776999999999999e-05 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472766+0000", 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0015e-05 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472932+0000", 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016676500000000001 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472944+0000", 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1749999999999999e-05 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484921+0000", 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011976686 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484941+0000", 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9976999999999999e-05 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.639 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.078688211, 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077763559999999999, 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:10.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7000000000000004e-07 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478380+0000", 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032185200000000002 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478395+0000", 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4484000000000001e-05 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478413+0000", 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7961999999999998e-05 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478717+0000", 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00030417999999999998 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478728+0000", 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0662000000000001e-05 2024-09-17T16:43:10.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.485798+0000", 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070707010000000004 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.485834+0000", 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5744999999999997e-05 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=82, reqid=client.4553.0:799, at_version=96'42, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.0761410920000001, 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014298085, 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480606+0000", 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.096e-06 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481691+0000", 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010850689999999999 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481709+0000", 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8060999999999999e-05 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481718+0000", 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3000000000000007e-06 2024-09-17T16:43:10.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481783+0000", 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4850000000000004e-05 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481793+0000", 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7149999999999993e-06 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494862+0000", 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013069404 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494903+0000", 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0590000000000003e-05 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=83, reqid=client.4553.0:800, at_version=96'43, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:10.649 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.0693257840000001, 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080848599999999993, 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487421+0000", 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0979999999999999e-06 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488035+0000", 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000613376 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488071+0000", 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6551999999999998e-05 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488079+0000", 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3070000000000003e-06 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488154+0000", 2024-09-17T16:43:10.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4250000000000002e-05 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488162+0000", 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8960000000000003e-06 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495348+0000", 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071863839999999997 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495505+0000", 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156997 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=84, reqid=client.4553.0:801, at_version=96'44, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.0613462380000001, 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.009364509, 2024-09-17T16:43:10.654 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:10.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0500000000000003e-07 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495948+0000", 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00054791099999999999 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495963+0000", 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4569999999999999e-05 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495971+0000", 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6200000000000005e-06 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496056+0000", 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4425000000000006e-05 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496065+0000", 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2420000000000006e-06 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504716+0000", 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086504779999999996 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504764+0000", 2024-09-17T16:43:10.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8557999999999998e-05 2024-09-17T16:43:10.659 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.659 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.659 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.659 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:10.659 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:10.659 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:10.660 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:43:10.661 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:10.659+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:10.761 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:10.759+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:10.811 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:10.811 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:10.812 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:10.820 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:43:10.862 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:10.860+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:10.924 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:10.924 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:10.924 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:10.924 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:10.924 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:10.932 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:43:10.976 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:10.974+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:11.036 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:11.036 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.551921288000003, 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079208060000000007, 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.037 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.038 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481603+0000", 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.75e-07 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482071+0000", 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046812600000000002 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.039 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482084+0000", 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3057000000000001e-05 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482091+0000", 2024-09-17T16:43:11.040 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3540000000000002e-06 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482223+0000", 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013139799999999999 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482253+0000", 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0824000000000002e-05 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.041 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489462+0000", 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007208356 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489523+0000", 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1216000000000005e-05 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.042 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.522299013000001, 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081810830000000005, 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.043 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511225+0000", 2024-09-17T16:43:11.044 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7099999999999998e-07 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511251+0000", 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6346000000000002e-05 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511262+0000", 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0501e-05 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.045 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511272+0000", 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9690000000000006e-06 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511337+0000", 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5390999999999998e-05 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511347+0000", 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8840000000000006e-06 2024-09-17T16:43:11.046 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519366+0000", 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080189979999999994 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519406+0000", 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9722999999999999e-05 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.047 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.51521426, 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015298559, 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.048 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518310+0000", 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.049e-06 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.049 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518764+0000", 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045328799999999999 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518781+0000", 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6999000000000001e-05 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518789+0000", 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8000000000000004e-06 2024-09-17T16:43:11.050 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518864+0000", 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4679999999999996e-05 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518876+0000", 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1732e-05 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533579+0000", 2024-09-17T16:43:11.051 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014703163 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533608+0000", 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8847999999999999e-05 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.052 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.443889224000003, 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010959406, 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.053 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.054 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.054 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:11.054 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.054 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.054 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590206+0000", 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000570752 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.055 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590220+0000", 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4301000000000001e-05 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590226+0000", 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1279999999999996e-06 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590291+0000", 2024-09-17T16:43:11.056 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4098999999999997e-05 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590299+0000", 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3659999999999992e-06 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600554+0000", 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010255060999999999 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.057 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600594+0000", 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9734000000000003e-05 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:11.058 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 37.439184353000002, 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077480170000000003, 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.059 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594340+0000", 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7199999999999998e-07 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594802+0000", 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046238699999999998 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.060 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594812+0000", 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4490000000000005e-06 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594817+0000", 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4070000000000001e-06 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594873+0000", 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6187000000000003e-05 2024-09-17T16:43:11.061 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594883+0000", 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0012e-05 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602063+0000", 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071793839999999996 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602087+0000", 2024-09-17T16:43:11.062 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4519e-05 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.fs4 61/34 ECSubWrite(tid=57, reqid=osd.13.0:57, at_version=61'8, trim_to=0'0, roll_forward_to=60'6))", 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.517669181000002, 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079238329999999999, 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.063 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515855+0000", 2024-09-17T16:43:11.064 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.39e-07 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515885+0000", 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0670999999999998e-05 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515896+0000", 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0227999999999999e-05 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.065 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515904+0000", 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516079+0000", 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017482700000000001 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516092+0000", 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2476e-05 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.066 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523739+0000", 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076475459999999999 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523778+0000", 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8964999999999997e-05 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.067 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 61/34 ECSubWrite(tid=56, reqid=osd.13.0:56, at_version=61'23, trim_to=0'0, roll_forward_to=60'21))", 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.517127174999999, 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081842100000000008, 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.068 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516397+0000", 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.71e-07 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.069 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516421+0000", 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4227e-05 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516436+0000", 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4278e-05 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516446+0000", 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0132999999999999e-05 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.070 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516504+0000", 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8096000000000001e-05 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516511+0000", 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5930000000000002e-06 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524540+0000", 2024-09-17T16:43:11.071 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080295439999999996 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524581+0000", 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0467999999999999e-05 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 61/34 ECSubWrite(tid=55, reqid=osd.0.0:55, at_version=61'49, trim_to=0'0, roll_forward_to=60'45))", 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:43:11.072 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.516500591000003, 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075496410000000002, 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.073 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517023+0000", 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517024+0000", 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6800000000000009e-07 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.074 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517047+0000", 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2843000000000001e-05 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517063+0000", 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6124999999999999e-05 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.075 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517072+0000", 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7569999999999993e-06 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517136+0000", 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3989e-05 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.076 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517146+0000", 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9550000000000004e-06 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524476+0000", 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073308189999999997 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524573+0000", 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6185000000000002e-05 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.077 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 32.579266044000001, 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088600729999999996, 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.078 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454258+0000", 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.079 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455027+0000", 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00076834799999999997 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455042+0000", 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5009e-05 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455048+0000", 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6560000000000003e-06 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.080 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0324e-05 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455119+0000", 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0755e-05 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463081+0000", 2024-09-17T16:43:11.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079613089999999997 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463118+0000", 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6878999999999997e-05 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 82/77 ECSubWrite(tid=55, reqid=client.4553.0:669, at_version=82'41, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:11.082 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.353498654999999, 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082065909999999992, 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:11.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.36e-07 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680539+0000", 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051415599999999999 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680553+0000", 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3949e-05 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680561+0000", 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.926e-06 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680619+0000", 2024-09-17T16:43:11.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8400000000000003e-05 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680628+0000", 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7290000000000006e-06 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.688193+0000", 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00756495 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.688231+0000", 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8345e-05 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 11.503937671999999, 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0084683799999999993, 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.087 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529587+0000", 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.153e-06 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530391+0000", 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00080430200000000001 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530407+0000", 2024-09-17T16:43:11.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5998000000000002e-05 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530416+0000", 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1700000000000003e-06 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530479+0000", 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2488000000000002e-05 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530490+0000", 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0764000000000001e-05 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.538031+0000", 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075414239999999997 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.538054+0000", 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3081000000000001e-05 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.091 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:05.469815+0000", 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.5637082710000003, 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017103197000000001, 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.469815+0000", 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.469815+0000", 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.469816+0000", 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9400000000000001e-07 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472623+0000", 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028072420000000002 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472634+0000", 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1291000000000001e-05 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472658+0000", 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3969999999999999e-05 2024-09-17T16:43:11.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472726+0000", 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7671999999999999e-05 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472735+0000", 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6730000000000004e-06 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.486878+0000", 2024-09-17T16:43:11.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014142531 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.486918+0000", 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0423999999999998e-05 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 96/34 ECSubWrite(tid=90, reqid=client.4553.0:781, at_version=96'81, trim_to=0'0, roll_forward_to=95'78))", 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.459080+0000", 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.5744435559999999, 2024-09-17T16:43:11.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076332079999999998, 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459080+0000", 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459080+0000", 2024-09-17T16:43:11.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459081+0000", 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2470000000000001e-06 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459118+0000", 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6483999999999998e-05 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459136+0000", 2024-09-17T16:43:11.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8505999999999999e-05 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459147+0000", 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0508e-05 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459213+0000", 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6267999999999996e-05 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459228+0000", 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4714e-05 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466621+0000", 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073931969999999998 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466713+0000", 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2283999999999999e-05 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.100 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 96/77 ECSubWrite(tid=369, reqid=osd.4.0:369, at_version=96'90, trim_to=0'0, roll_forward_to=95'88))", 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.5741358920000001, 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085276350000000004, 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5699999999999998e-07 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459412+0000", 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3810000000000001e-05 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459470+0000", 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7849999999999997e-05 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459477+0000", 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4869999999999996e-06 2024-09-17T16:43:11.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459571+0000", 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3789999999999995e-05 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459582+0000", 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0675e-05 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467874+0000", 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082924409999999994 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467915+0000", 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1224999999999999e-05 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 96/34 ECSubWrite(tid=92, reqid=client.4553.0:792, at_version=96'84, trim_to=0'0, roll_forward_to=95'78))", 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.464015+0000", 2024-09-17T16:43:11.105 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.5695087939999999, 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078069869999999996, 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464015+0000", 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464015+0000", 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464016+0000", 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.159e-06 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464078+0000", 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2198000000000003e-05 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464100+0000", 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1622999999999999e-05 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464110+0000", 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8730000000000002e-06 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464218+0000", 2024-09-17T16:43:11.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010807900000000001 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464229+0000", 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0934999999999999e-05 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471761+0000", 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007532815 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471822+0000", 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0304999999999999e-05 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.466279+0000", 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.567244291, 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012657313999999999, 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.110 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466279+0000", 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466279+0000", 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466281+0000", 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.567e-06 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467073+0000", 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00079186999999999997 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467090+0000", 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7747000000000001e-05 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467100+0000", 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8339999999999994e-06 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467191+0000", 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1209e-05 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467202+0000", 2024-09-17T16:43:11.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0139999999999999e-05 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478897+0000", 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011695008999999999 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478937+0000", 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9938000000000003e-05 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.470478+0000", 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.5630451089999999, 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015879730000000002, 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.115 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470478+0000", 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470478+0000", 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470479+0000", 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470661+0000", 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018251300000000001 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470672+0000", 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0900999999999999e-05 2024-09-17T16:43:11.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470680+0000", 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8669999999999994e-06 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472527+0000", 2024-09-17T16:43:11.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0018469440000000001 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472536+0000", 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1419999999999999e-06 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.486311+0000", 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013774606 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.486358+0000", 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7298e-05 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.478955+0000", 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.5545681060000001, 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010500262, 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.120 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478955+0000", 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478955+0000", 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478956+0000", 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7300000000000005e-07 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479148+0000", 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000192122 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479184+0000", 2024-09-17T16:43:11.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5651999999999997e-05 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479202+0000", 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8212000000000001e-05 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479281+0000", 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8427e-05 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479290+0000", 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3919999999999992e-06 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.489421+0000", 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010131127 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.489456+0000", 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4456999999999999e-05 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 1.554263704, 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.023017270999999999, 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.125 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8699999999999995e-07 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479850+0000", 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059002700000000002 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479863+0000", 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2609000000000001e-05 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479871+0000", 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6179999999999997e-06 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479947+0000", 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6769999999999999e-05 2024-09-17T16:43:11.128 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479959+0000", 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1384e-05 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502238+0000", 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022279576999999998 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502277+0000", 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8798999999999999e-05 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 97/34 ECSubWrite(tid=388, reqid=client.4553.0:815, at_version=97'132, trim_to=0'0, roll_forward_to=97'130))", 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:10.484836+0000", 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.54868756200000002, 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078964440000000007, 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:11.130 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.484836+0000", 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.484836+0000", 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.484837+0000", 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.16e-07 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485040+0000", 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020355899999999999 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485053+0000", 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3132000000000001e-05 2024-09-17T16:43:11.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485059+0000", 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9340000000000003e-06 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485121+0000", 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1911999999999999e-05 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485132+0000", 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0831e-05 2024-09-17T16:43:11.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.492699+0000", 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075671799999999997 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.492732+0000", 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3080000000000002e-05 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:11.134 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:11.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:11.136 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:11.133+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:11.137 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:43:11.237 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:11.235+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:11.261 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:11.261 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:11.279 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:11.279 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:11.280 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:11.280 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:11.280 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:11.280 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:11.289 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:43:11.296 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:11.296 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:11.313 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:11.313 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:11.329 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:11.329 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:11.338 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:11.336+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:11.347 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:11.347 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:11.364 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:11.364 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:11.381 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:11.381 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:11.392 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:11.393 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:11.393 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:11.393 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:11.393 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:11.397 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:11.397 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:11.401 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:43:11.416 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:11.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:11.439 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:11.437+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.10 to 1 (10000) 2024-09-17T16:43:11.448 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:11.454 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:43:11.454 INFO:tasks.rados.rados.0.smithi183.stdout:327: done (3 left) 2024-09-17T16:43:11.454 INFO:tasks.rados.rados.0.smithi183.stdout:328: done (2 left) 2024-09-17T16:43:11.454 INFO:tasks.rados.rados.0.smithi183.stdout:329: done (1 left) 2024-09-17T16:43:11.455 INFO:tasks.rados.rados.0.smithi183.stdout:330: done (0 left) 2024-09-17T16:43:11.455 INFO:tasks.rados.rados.0.smithi183.stdout:331: snap_create 2024-09-17T16:43:11.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-17T16:43:11.466 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:11.467 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:11.484 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:11.484 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:11.502 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:11.502 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:11.505 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:11.505 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:11.514 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:43:11.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:11.516+0000 7f0458b89640 0 -- 172.21.15.60:0/4112329982 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f04542243b0 msgr2=0x7f04542267a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:11.520 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:11.539 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:11.538+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:11.617 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:11.619 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:11.626 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:43:11.640 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:11.639+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:11.729 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:11.729 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:11.738 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:43:11.741 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:11.740+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:11.842 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:11.840+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:11.842 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:11.842 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:11.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:43:11.943 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:11.941+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:11.958 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:11.959 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:11.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:43:12.043 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:12.041+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:12.076 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.076 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:43:12.145 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:12.143+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:12.233 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.234 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.242 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:43:12.245 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:12.243+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:12.346 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:12.344+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:12.349 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.349 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:43:12.446 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:12.444+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.11 to 1 (10000) 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:331: done (0 left) 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:332: rollback oid 2 current snap is 35 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 2 to 33 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:333: rmattr oid 6 current snap is 35 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:333: done (1 left) 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 4 current snap is 35 2024-09-17T16:43:12.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: seq_num 127 ranges {1884160=589824,2473984=753664,3227648=475136,3702784=327680} 2024-09-17T16:43:12.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-17T16:43:12.467 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.467 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.469 INFO:tasks.rados.rados.0.smithi183.stdout:334: writing smithi18337221-4 from 1884160 to 2473984 tid 1 2024-09-17T16:43:12.473 INFO:tasks.rados.rados.0.smithi183.stdout:334: writing smithi18337221-4 from 2473984 to 3227648 tid 2 2024-09-17T16:43:12.476 INFO:tasks.rados.rados.0.smithi183.stdout:334: writing smithi18337221-4 from 3227648 to 3702784 tid 3 2024-09-17T16:43:12.478 INFO:tasks.rados.rados.0.smithi183.stdout:334: writing smithi18337221-4 from 3702784 to 4030464 tid 4 2024-09-17T16:43:12.479 INFO:tasks.rados.rados.0.smithi183.stdout:335: delete oid 25 current snap is 35 2024-09-17T16:43:12.479 INFO:tasks.rados.rados.0.smithi183.stdout:332: finishing rollback tid 0 to smithi18337221-2 2024-09-17T16:43:12.479 INFO:tasks.rados.rados.0.smithi183.stdout:332: finishing rollback tid 1 to smithi18337221-2 2024-09-17T16:43:12.479 INFO:tasks.rados.rados.0.smithi183.stdout:332: finishing rollback tid 2 to smithi18337221-2 2024-09-17T16:43:12.479 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 2 v 72 (ObjNum 82 snap 13 seq_num 82) dirty exists 2024-09-17T16:43:12.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:43:12.484 INFO:tasks.rados.rados.0.smithi183.stdout:332: done (2 left) 2024-09-17T16:43:12.484 INFO:tasks.rados.rados.0.smithi183.stdout:335: done (1 left) 2024-09-17T16:43:12.484 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 5 current snap is 35 2024-09-17T16:43:12.484 INFO:tasks.rados.rados.0.smithi183.stdout:336: seq_num 129 ranges {81920=622592,704512=655360,1359872=688128,2048000=212992} 2024-09-17T16:43:12.488 INFO:tasks.rados.rados.0.smithi183.stdout:336: writing smithi18337221-5 from 81920 to 704512 tid 1 2024-09-17T16:43:12.492 INFO:tasks.rados.rados.0.smithi183.stdout:336: writing smithi18337221-5 from 704512 to 1359872 tid 2 2024-09-17T16:43:12.496 INFO:tasks.rados.rados.0.smithi183.stdout:336: writing smithi18337221-5 from 1359872 to 2048000 tid 3 2024-09-17T16:43:12.497 INFO:tasks.rados.rados.0.smithi183.stdout:336: writing smithi18337221-5 from 2048000 to 2260992 tid 4 2024-09-17T16:43:12.497 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 31 current snap is 35 2024-09-17T16:43:12.498 INFO:tasks.rados.rados.0.smithi183.stdout:334: finishing write tid 1 to smithi18337221-4 2024-09-17T16:43:12.498 INFO:tasks.rados.rados.0.smithi183.stdout:337: seq_num 130 ranges {0=638976,638976=671744,1310720=802816,2113536=81920} 2024-09-17T16:43:12.501 INFO:tasks.rados.rados.0.smithi183.stdout:337: writing smithi18337221-31 from 0 to 638976 tid 1 2024-09-17T16:43:12.504 INFO:tasks.rados.rados.0.smithi183.stdout:337: writing smithi18337221-31 from 638976 to 1310720 tid 2 2024-09-17T16:43:12.509 INFO:tasks.rados.rados.0.smithi183.stdout:337: writing smithi18337221-31 from 1310720 to 2113536 tid 3 2024-09-17T16:43:12.509 INFO:tasks.rados.rados.0.smithi183.stdout:337: writing smithi18337221-31 from 2113536 to 2195456 tid 4 2024-09-17T16:43:12.509 INFO:tasks.rados.rados.0.smithi183.stdout:338: snap_remove snap 31 2024-09-17T16:43:12.547 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:12.545+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:12.631 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.631 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.640 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:43:12.683 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:12.681+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:12.748 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.748 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.749 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:12.747+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:12.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:43:12.852 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:12.851+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:12.904 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:12.905 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:12.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:43:12.953 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:12.951+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:13.021 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:13.021 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:13.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:43:13.053 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:13.051+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:13.137 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:13.137 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:13.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:43:13.155 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:13.153+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:13.252 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:13.252 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:13.255 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:13.253+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:13.261 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:43:13.356 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:13.355+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:13.408 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:13.409 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:13.417 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:43:13.451 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.12 to 1 (10000) 2024-09-17T16:43:13.455 INFO:tasks.rados.rados.0.smithi183.stdout:338: done (3 left) 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:339: copy_from oid 50 from oid 36 current snap is 35 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: finishing write tid 2 to smithi18337221-4 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: finishing write tid 3 to smithi18337221-4 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: finishing write tid 4 to smithi18337221-4 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: finishing write tid 5 to smithi18337221-4 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: finishing write tid 6 to smithi18337221-4 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: oid 4 updating version 0 to 195 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: oid 4 updating version 195 to 196 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: oid 4 updating version 196 to 197 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: oid 4 version 197 is already newer than 194 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:334: oid 4 version 197 is already newer than 193 2024-09-17T16:43:13.456 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 4 v 197 (ObjNum 127 snap 35 seq_num 127) dirty exists 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:334: left oid 4 (ObjNum 127 snap 35 seq_num 127) 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: finishing write tid 1 to smithi18337221-5 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: finishing write tid 2 to smithi18337221-5 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: finishing write tid 3 to smithi18337221-5 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: finishing write tid 4 to smithi18337221-5 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: finishing write tid 5 to smithi18337221-5 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:337: finishing write tid 1 to smithi18337221-31 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: finishing write tid 6 to smithi18337221-5 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: oid 5 updating version 0 to 75 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: oid 5 updating version 75 to 77 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: oid 5 updating version 77 to 78 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: oid 5 version 78 is already newer than 76 2024-09-17T16:43:13.457 INFO:tasks.rados.rados.0.smithi183.stdout:336: oid 5 updating version 78 to 79 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 5 v 79 (ObjNum 129 snap 35 seq_num 129) dirty exists 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:336: left oid 5 (ObjNum 129 snap 35 seq_num 129) 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: finishing write tid 2 to smithi18337221-31 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:334: done (3 left) 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:336: done (2 left) 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:340: copy_from oid 29 from oid 11 current snap is 35 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: finishing write tid 3 to smithi18337221-31 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: finishing write tid 4 to smithi18337221-31 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: finishing write tid 5 to smithi18337221-31 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: finishing write tid 6 to smithi18337221-31 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: oid 31 updating version 0 to 61 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: oid 31 updating version 61 to 63 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: oid 31 updating version 63 to 65 2024-09-17T16:43:13.458 INFO:tasks.rados.rados.0.smithi183.stdout:337: oid 31 version 65 is already newer than 64 2024-09-17T16:43:13.459 INFO:tasks.rados.rados.0.smithi183.stdout:337: oid 31 version 65 is already newer than 62 2024-09-17T16:43:13.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 31 v 65 (ObjNum 130 snap 35 seq_num 130) dirty exists 2024-09-17T16:43:13.459 INFO:tasks.rados.rados.0.smithi183.stdout:337: left oid 31 (ObjNum 130 snap 35 seq_num 130) 2024-09-17T16:43:13.459 INFO:tasks.rados.rados.0.smithi183.stdout:337: done (2 left) 2024-09-17T16:43:13.459 INFO:tasks.rados.rados.0.smithi183.stdout:341: snap_remove snap 34 2024-09-17T16:43:13.460 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:13.458+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:13.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:43:13.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-17T16:43:13.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:43:13.541 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:13.541 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:13.550 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:43:13.595 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:13.593+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:13.658 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:13.658 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:13.662 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:13.660+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:13.666 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:43:13.687 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:13.687 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:13.704 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:13.705 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:13.722 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:13.722 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:13.738 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:13.739 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:13.755 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:13.755 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:13.763 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:13.761+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:13.771 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:13.772 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:13.788 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:13.789 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:13.805 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:13.806 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.317462737, 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012796989999999999, 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.811 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3699999999999999e-07 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492041+0000", 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014080290000000001 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.813 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492061+0000", 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9678e-05 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492070+0000", 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4050000000000006e-06 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492139+0000", 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8300000000000007e-05 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.814 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492148+0000", 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7049999999999994e-06 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503396+0000", 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011248081 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.815 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503430+0000", 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3555e-05 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:13.816 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.310328978999998, 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078697639999999996, 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.817 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8100000000000002e-07 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497784+0000", 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-17T16:43:13.818 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497795+0000", 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0983e-05 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497803+0000", 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2209999999999997e-06 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.819 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497860+0000", 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6886999999999999e-05 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497870+0000", 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0091999999999999e-05 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505602+0000", 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077316379999999999 2024-09-17T16:43:13.820 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505636+0000", 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4677e-05 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.309136993999999, 2024-09-17T16:43:13.821 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069241900000000002, 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:13.822 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4700000000000001e-07 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499112+0000", 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015267500000000001 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.823 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499122+0000", 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0473e-05 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499130+0000", 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1799999999999999e-06 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499180+0000", 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0114999999999997e-05 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.824 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499186+0000", 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5169999999999996e-06 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505852+0000", 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066659800000000002 2024-09-17T16:43:13.825 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505883+0000", 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.308422960000001, 2024-09-17T16:43:13.826 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059870100000000001, 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:13.827 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.828 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499973+0000", 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029958099999999999 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499984+0000", 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.08e-05 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499992+0000", 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5210000000000002e-06 2024-09-17T16:43:13.829 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500153+0000", 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016087299999999999 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500161+0000", 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1170000000000004e-06 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.830 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505641+0000", 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054796269999999999 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505660+0000", 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8989999999999999e-05 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.831 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 54.296705701999997, 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061959889999999998, 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.832 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:13.833 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9900000000000002e-07 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511532+0000", 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014124600000000001 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.834 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511545+0000", 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3609e-05 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511555+0000", 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8220000000000002e-06 2024-09-17T16:43:13.835 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511630+0000", 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4807000000000004e-05 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511649+0000", 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9434000000000001e-05 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.836 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517548+0000", 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058984140000000003 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517586+0000", 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8358000000000001e-05 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:43:13.837 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 50.334552096000003, 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061901810000000003, 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.838 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473545+0000", 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:43:13.839 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474135+0000", 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000589867 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474152+0000", 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6772000000000001e-05 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.840 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474160+0000", 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6670000000000002e-06 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474226+0000", 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5572000000000002e-05 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.841 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474235+0000", 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8529999999999998e-06 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479694+0000", 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054593849999999998 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.842 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479734+0000", 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9449000000000001e-05 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=123, reqid=osd.4.0:123, at_version=55'41, trim_to=0'0, roll_forward_to=53'37))", 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.320696585999997, 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058804240000000004, 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.843 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487399+0000", 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.844 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487400+0000", 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8199999999999998e-07 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487417+0000", 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6994999999999999e-05 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.845 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487428+0000", 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1534e-05 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487436+0000", 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7470000000000005e-06 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487487+0000", 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0637999999999999e-05 2024-09-17T16:43:13.846 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.487494+0000", 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0199999999999997e-06 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493233+0000", 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057390399999999999 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.847 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.493279+0000", 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6567999999999999e-05 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 55/34 ECSubWrite(tid=134, reqid=client.4553.0:379, at_version=55'47, trim_to=0'0, roll_forward_to=55'43))", 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.286904898000003, 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058772110000000002, 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.848 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521191+0000", 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.849 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521192+0000", 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3699999999999999e-07 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521211+0000", 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8970999999999998e-05 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521224+0000", 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3029e-05 2024-09-17T16:43:13.850 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521233+0000", 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3829999999999998e-06 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521288+0000", 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5379e-05 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521298+0000", 2024-09-17T16:43:13.851 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.527031+0000", 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057332720000000002 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.527068+0000", 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.7110999999999998e-05 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.852 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 55/34 ECSubWrite(tid=39, reqid=client.4553.0:386, at_version=55'14, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.210109649000003, 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006518182, 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.853 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9999999999999999e-07 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.854 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598219+0000", 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023223800000000001 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598246+0000", 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7399e-05 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598270+0000", 2024-09-17T16:43:13.855 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4323000000000001e-05 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598348+0000", 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7309000000000001e-05 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598364+0000", 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6724000000000001e-05 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.856 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604459+0000", 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060950049999999997 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604504+0000", 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4883999999999999e-05 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.857 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 61/34 ECSubWrite(tid=170, reqid=osd.4.0:170, at_version=61'65, trim_to=0'0, roll_forward_to=60'61))", 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.278475331000003, 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068917400000000004, 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.858 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529621+0000", 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8400000000000004e-07 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529638+0000", 2024-09-17T16:43:13.859 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7316000000000002e-05 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529650+0000", 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1790000000000001e-05 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529656+0000", 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.801e-06 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.860 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529702+0000", 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6038999999999997e-05 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529709+0000", 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4919999999999996e-06 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536483+0000", 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067733170000000001 2024-09-17T16:43:13.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536512+0000", 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9300999999999999e-05 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 82/77 ECSubWrite(tid=182, reqid=client.4553.0:643, at_version=82'82, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.328400984000002, 2024-09-17T16:43:13.862 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073096100000000002, 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:13.863 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0299999999999998e-07 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479881+0000", 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018565199999999999 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.864 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479896+0000", 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5038999999999999e-05 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479905+0000", 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1940000000000004e-06 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479963+0000", 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7911000000000002e-05 2024-09-17T16:43:13.865 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479974+0000", 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0271e-05 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.486966+0000", 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069925229999999996 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.487004+0000", 2024-09-17T16:43:13.866 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8216999999999997e-05 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.ds1 91/77 ECSubWrite(tid=329, reqid=osd.4.0:329, at_version=91'16, trim_to=0'0, roll_forward_to=90'14))", 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.3498707020000005, 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079773259999999999, 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.867 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.868 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0899999999999997e-07 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458253+0000", 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7518999999999999e-05 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458263+0000", 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9790000000000005e-06 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.869 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458272+0000", 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4099999999999997e-06 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458763+0000", 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049112099999999996 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458773+0000", 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173000000000001e-05 2024-09-17T16:43:13.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466157+0000", 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073830600000000003 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466202+0000", 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5754999999999998e-05 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 91/77 ECSubWrite(tid=74, reqid=osd.8.0:74, at_version=91'58, trim_to=0'0, roll_forward_to=85'56))", 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.3497229260000001, 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078262980000000006, 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:13.872 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9000000000000001e-07 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.873 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458400+0000", 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6882000000000001e-05 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458411+0000", 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1304000000000001e-05 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458420+0000", 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0890000000000006e-06 2024-09-17T16:43:13.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459049+0000", 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062910699999999995 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459059+0000", 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8390000000000002e-06 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.875 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466166+0000", 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071070860000000003 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466199+0000", 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2801e-05 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 91/34 ECSubWrite(tid=58, reqid=client.4553.0:720, at_version=91'44, trim_to=0'0, roll_forward_to=85'42))", 2024-09-17T16:43:13.876 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.3465976949999998, 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087023320000000001, 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.877 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.878 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:13.878 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.880 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.880 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.880 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:13.880 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.01e-07 2024-09-17T16:43:13.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461630+0000", 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013193699999999999 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461643+0000", 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.295e-05 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.881 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461653+0000", 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6709999999999994e-06 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461732+0000", 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9746999999999994e-05 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461744+0000", 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1513e-05 2024-09-17T16:43:13.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470159+0000", 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084150249999999996 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470200+0000", 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1387999999999997e-05 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.883 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 91/77 ECSubWrite(tid=200, reqid=osd.2.0:199, at_version=0'0, trim_to=0'0, roll_forward_to=91'99))", 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.463940+0000", 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 9.3441553200000005, 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006245736, 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463940+0000", 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.884 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463940+0000", 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463941+0000", 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8599999999999997e-07 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.885 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463951+0000", 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0101999999999999e-05 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463964+0000", 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2628e-05 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463970+0000", 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3219999999999998e-06 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.886 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.464034+0000", 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3356999999999997e-05 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.464046+0000", 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2928000000000001e-05 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470147+0000", 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061000409999999996 2024-09-17T16:43:13.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470186+0000", 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9572e-05 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 96/34 ECSubWrite(tid=373, reqid=osd.4.0:373, at_version=96'127, trim_to=0'0, roll_forward_to=95'125))", 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3379076620000001, 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006053971, 2024-09-17T16:43:13.888 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.889 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0400000000000002e-07 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470219+0000", 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0837000000000003e-05 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470233+0000", 2024-09-17T16:43:13.890 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4102e-05 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470244+0000", 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0662000000000001e-05 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470330+0000", 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6407000000000001e-05 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.891 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470343+0000", 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2680999999999999e-05 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476141+0000", 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057983399999999999 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.892 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476242+0000", 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010063799999999999 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 96/77 ECSubWrite(tid=214, reqid=osd.2.0:213, at_version=0'0, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:09.470756+0000", 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 4.3373400279999998, 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060055309999999997, 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.893 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470756+0000", 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470756+0000", 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.894 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470757+0000", 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9599999999999998e-07 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470776+0000", 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9735999999999999e-05 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470788+0000", 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1508000000000001e-05 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.895 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470796+0000", 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0360000000000006e-06 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470885+0000", 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9172999999999995e-05 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470894+0000", 2024-09-17T16:43:13.896 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2920000000000001e-06 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476729+0000", 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00583426 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476761+0000", 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2629999999999998e-05 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 97/77 ECSubWrite(tid=215, reqid=client.4553.0:806, at_version=97'117, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3492867359999998, 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085031619999999999, 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:13.898 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5800000000000001e-07 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.899 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459133+0000", 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000324247 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459146+0000", 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2792999999999999e-05 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459162+0000", 2024-09-17T16:43:13.900 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5546e-05 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459240+0000", 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8681000000000001e-05 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459255+0000", 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4602e-05 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.901 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.467251+0000", 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079958670000000003 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.467312+0000", 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1267999999999997e-05 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.902 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 97/77 ECSubWrite(tid=216, reqid=client.4553.0:807, at_version=97'118, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:10.464209+0000", 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3438863009999999, 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068683950000000002, 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464209+0000", 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.903 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464209+0000", 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464210+0000", 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6499999999999998e-07 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464495+0000", 2024-09-17T16:43:13.904 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028513200000000001 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464509+0000", 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3644e-05 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464521+0000", 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2011000000000001e-05 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.905 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464585+0000", 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4358999999999998e-05 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464593+0000", 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1790000000000002e-06 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.471041+0000", 2024-09-17T16:43:13.906 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064483229999999997 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.471078+0000", 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6881999999999997e-05 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 97/77 ECSubWrite(tid=218, reqid=client.4553.0:809, at_version=97'120, trim_to=0'0, roll_forward_to=97'117))", 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:10.472435+0000", 2024-09-17T16:43:13.907 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 3.3356607079999998, 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058915490000000003, 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472435+0000", 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.908 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472435+0000", 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472436+0000", 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4e-07 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472624+0000", 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000187708 2024-09-17T16:43:13.909 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472641+0000", 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472652+0000", 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1759e-05 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472711+0000", 2024-09-17T16:43:13.910 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8780999999999998e-05 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472731+0000", 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9666000000000001e-05 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.478300+0000", 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055694480000000003 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.478327+0000", 2024-09-17T16:43:13.911 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6301000000000001e-05 2024-09-17T16:43:13.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.912 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.912 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:13.912 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:13.912 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:13.913 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:13.914 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:13.911+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:13.914 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:13.914 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:13.914 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:13.915 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:43:13.915 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:13.916 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:13.917 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:13.917 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:13.917 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:13.917 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:13.919+0000 7fd0ad8b0640 0 -- 172.21.15.60:0/256984913 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7fd0a8220e90 msgr2=0x7fd0a8223280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:13.923 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:13.941 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:14.014 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:14.013+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:14.020 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.020 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:14.020 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:14.020 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.029 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:43:14.115 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:14.113+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:14.132 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.133 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:14.133 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:14.133 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:14.133 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.141 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:43:14.217 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:14.215+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:187 3.cs0 3:385cb74d:::smithi18337221-1:head [copy-from ver 8] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:43:14.247 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.766347691, 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.039364976000000003, 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 187 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477629+0000", 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477631+0000", 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2740000000000002e-06 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477644+0000", 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2748999999999999e-05 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477673+0000", 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8603e-05 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477688+0000", 2024-09-17T16:43:14.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5454000000000001e-05 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477843+0000", 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015473799999999999 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477862+0000", 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8953e-05 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480146+0000", 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022843439999999998 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480220+0000", 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3986999999999995e-05 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.510626+0000", 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.030406048000000001 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.515100+0000", 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044740450000000003 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516938+0000", 2024-09-17T16:43:14.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001837736 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.516994+0000", 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6045000000000003e-05 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:188 3.cs0 3:385cb74d:::smithi18337221-1:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.766241719, 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.036238998000000001, 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 188 2024-09-17T16:43:14.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477735+0000", 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477736+0000", 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.494e-06 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477742+0000", 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8930000000000002e-06 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477763+0000", 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0942999999999999e-05 2024-09-17T16:43:14.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477781+0000", 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7479999999999999e-05 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00019260600000000001 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477980+0000", 2024-09-17T16:43:14.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4829999999999996e-06 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480439+0000", 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0024594259999999998 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.480480+0000", 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0512000000000001e-05 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513848+0000", 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033368666999999998 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513906+0000", 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7203000000000001e-05 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.513974+0000", 2024-09-17T16:43:14.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8291000000000001e-05 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:191 3.cs0 3:3f892186:::smithi18337221-33:head [append 0~0] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.766048021000003, 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020837920999999999, 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.261 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 191 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477932+0000", 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2389999999999998e-06 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477939+0000", 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8530000000000003e-06 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477944+0000", 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3279999999999999e-06 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478088+0000", 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014464 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478091+0000", 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6900000000000001e-06 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482685+0000", 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045939370000000002 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.482783+0000", 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8634000000000005e-05 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483160+0000", 2024-09-17T16:43:14.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000376645 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.484086+0000", 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000926092 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498688+0000", 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014601930000000001 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498767+0000", 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8502000000000002e-05 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:192 3.cs0 3:3e21370b:::smithi18337221-11:head [copy-from ver 6] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.766014052000003, 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028471962999999999, 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.268 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 192 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477963+0000", 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0999999999999999e-07 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477966+0000", 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0769999999999999e-06 2024-09-17T16:43:14.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477973+0000", 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5239999999999997e-06 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477976+0000", 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2399999999999999e-06 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478121+0000", 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000145038 2024-09-17T16:43:14.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478126+0000", 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4480000000000002e-06 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483386+0000", 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0052599209999999999 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483472+0000", 2024-09-17T16:43:14.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6159e-05 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492564+0000", 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0090913120000000007 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.501360+0000", 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008796313 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506376+0000", 2024-09-17T16:43:14.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0050161659999999999 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.506435+0000", 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8354999999999999e-05 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:193 3.cs0 3:3e21370b:::smithi18337221-11:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 60.765994972000001, 2024-09-17T16:43:14.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020602901, 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 193 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:14.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477982+0000", 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477983+0000", 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3909999999999999e-06 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477992+0000", 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5669999999999995e-06 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.477995+0000", 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9119999999999998e-06 2024-09-17T16:43:14.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478149+0000", 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000153695 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.478153+0000", 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5990000000000004e-06 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483619+0000", 2024-09-17T16:43:14.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054658809999999997 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.483650+0000", 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1115999999999998e-05 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498397+0000", 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014746853000000001 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498485+0000", 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8203999999999998e-05 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9411000000000001e-05 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:428 3.cs0 3:3f892186:::smithi18337221-33:head [read 0~1687552,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-17T16:43:14.280 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 40.739940351000001, 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019143165, 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 428 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504036+0000", 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504037+0000", 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0500000000000004e-07 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504046+0000", 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6400000000000003e-06 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504053+0000", 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3730000000000004e-06 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.504058+0000", 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2970000000000003e-06 2024-09-17T16:43:14.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512478+0000", 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084197920000000006 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.512531+0000", 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3173000000000001e-05 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.523180+0000", 2024-09-17T16:43:14.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010648385 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:547 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~442368] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.446495+0000", 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.797481577999999, 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022970733, 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.285 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 547 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.446495+0000", 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.446495+0000", 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.446497+0000", 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9759999999999998e-06 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.447838+0000", 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001341128 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.447853+0000", 2024-09-17T16:43:14.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5031000000000001e-05 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.447862+0000", 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6389999999999998e-06 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.448065+0000", 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00020313199999999999 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.448143+0000", 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7983000000000002e-05 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449404+0000", 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001260703 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.289 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.461546+0000", 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012142457000000001 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469401+0000", 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078549090000000002 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.292 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469466+0000", 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4775000000000002e-05 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:548 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~540672] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.450979+0000", 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.792997856, 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019762076999999999, 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.293 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 548 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450979+0000", 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.294 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450979+0000", 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450981+0000", 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0159999999999998e-06 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.452224+0000", 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00124329 2024-09-17T16:43:14.295 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.452236+0000", 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.198e-05 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.452244+0000", 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1100000000000003e-06 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.296 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.456000+0000", 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003756059 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.456104+0000", 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104002 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457099+0000", 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099512199999999998 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.297 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469478+0000", 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012378867999999999 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.470686+0000", 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0012076789999999999 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.470741+0000", 2024-09-17T16:43:14.298 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4951000000000003e-05 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:549 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~622592] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.454425+0000", 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.789551632999999, 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019199834999999998, 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.299 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 549 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454425+0000", 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.300 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454425+0000", 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454427+0000", 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6929999999999999e-06 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454960+0000", 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00053344899999999997 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.301 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454973+0000", 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2962999999999999e-05 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454982+0000", 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5019999999999992e-06 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.461659+0000", 2024-09-17T16:43:14.302 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066771679999999998 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.461773+0000", 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113909 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462609+0000", 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00083654400000000005 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.303 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471322+0000", 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087130349999999992 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473580+0000", 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022580149999999999 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473625+0000", 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4557e-05 2024-09-17T16:43:14.304 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:550 3.5s0 3:af4951e1:::smithi18337221-22:head [setxattr _header (57) in=7b] snapc 14=[14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.454999+0000", 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.78897753, 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018831691000000001, 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.305 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 550 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454999+0000", 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454999+0000", 2024-09-17T16:43:14.306 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455000+0000", 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6300000000000004e-07 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455004+0000", 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3159999999999998e-06 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.307 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455015+0000", 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.057e-05 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455023+0000", 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7749999999999993e-06 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468685+0000", 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013661819 2024-09-17T16:43:14.308 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468753+0000", 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8610999999999998e-05 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469078+0000", 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000324622 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.309 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471328+0000", 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002249905 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473758+0000", 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00243071 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.473831+0000", 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.25e-05 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.310 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:551 3.5s0 3:af4951e1:::smithi18337221-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e72)", 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.455033+0000", 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 28.788943750000001, 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022406839000000001, 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.311 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 551 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455033+0000", 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455033+0000", 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.312 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455034+0000", 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5799999999999999e-07 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455036+0000", 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8600000000000001e-06 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455043+0000", 2024-09-17T16:43:14.313 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7649999999999996e-06 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455048+0000", 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1100000000000002e-06 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469616+0000", 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01456813 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:14.314 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.469663+0000", 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6594000000000001e-05 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.474132+0000", 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0044686379999999996 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.474189+0000", 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.315 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.477440+0000", 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0032510320000000001 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:633 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~589824] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.452956+0000", 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.791020433, 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.027916025000000001, 2024-09-17T16:43:14.316 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 633 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.452956+0000", 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.317 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.452956+0000", 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.452958+0000", 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0530000000000001e-06 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.318 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454817+0000", 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001858869 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454832+0000", 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5268e-05 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454839+0000", 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9369999999999998e-06 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.319 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454896+0000", 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6604000000000002e-05 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.454978+0000", 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2338999999999999e-05 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.320 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456403+0000", 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001424554 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470133+0000", 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013729698 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.480770+0000", 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010637814000000001 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.321 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.480872+0000", 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000101889 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:634 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~540672] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.456107+0000", 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.787870157, 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024951943000000001, 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.322 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 634 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456107+0000", 2024-09-17T16:43:14.323 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456107+0000", 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.456108+0000", 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0899999999999999e-06 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.324 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.457301+0000", 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011931730000000001 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.457316+0000", 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5129e-05 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.457323+0000", 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9949999999999999e-06 2024-09-17T16:43:14.325 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460503+0000", 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0031804720000000002 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460580+0000", 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6725999999999997e-05 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.326 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.461390+0000", 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00081024999999999999 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470134+0000", 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008743275 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.480994+0000", 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010860409 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.327 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481058+0000", 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4424000000000005e-05 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:635 3.cs0 3:38e3a789:::smithi18337221-8:head [append 0~622592] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.459904+0000", 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.784072535, 2024-09-17T16:43:14.328 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021398255000000001, 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 635 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.459904+0000", 2024-09-17T16:43:14.329 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.459904+0000", 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.459905+0000", 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8000000000000004e-07 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.330 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460548+0000", 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064323600000000005 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460558+0000", 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4569999999999994e-06 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460565+0000", 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9739999999999996e-06 2024-09-17T16:43:14.331 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.465197+0000", 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046320679999999996 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.465301+0000", 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000104683 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.332 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.466142+0000", 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084027899999999998 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.471330+0000", 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0051884339999999996 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481226+0000", 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098959479999999999 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.333 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481302+0000", 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6296000000000003e-05 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:636 3.cs0 3:38e3a789:::smithi18337221-8:head [setxattr _header (56) in=7b] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.460577+0000", 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.783399645999999, 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020964282000000001, 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.334 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 636 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460577+0000", 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.335 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460577+0000", 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460578+0000", 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4900000000000005e-07 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460580+0000", 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5689999999999999e-06 2024-09-17T16:43:14.336 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460585+0000", 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1919999999999998e-06 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460588+0000", 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3230000000000002e-06 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.337 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470174+0000", 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0095856139999999992 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470254+0000", 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0918e-05 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470569+0000", 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00031447799999999998 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.338 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.471354+0000", 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00078461999999999998 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481457+0000", 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.01010314 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481541+0000", 2024-09-17T16:43:14.339 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4678999999999993e-05 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:637 3.cs0 3:38e3a789:::smithi18337221-8:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 18.783383737000001, 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022673713000000002, 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:14.340 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 637 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.341 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460593+0000", 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4400000000000001e-07 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460595+0000", 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3829999999999999e-06 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.342 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460599+0000", 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9829999999999998e-06 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.460602+0000", 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.444e-06 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470826+0000", 2024-09-17T16:43:14.343 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010223563 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.470926+0000", 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000100583 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.481937+0000", 2024-09-17T16:43:14.344 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011010423 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.482000+0000", 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3155000000000001e-05 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.483267+0000", 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001266835 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.345 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:724 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~770048] snapc 1f=[1e,1c,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:05.454429+0000", 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7895476749999997, 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.024336996999999999, 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.346 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 724 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.454429+0000", 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.454429+0000", 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.347 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.454431+0000", 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7889999999999999e-06 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.455752+0000", 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.001321179 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.348 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.455771+0000", 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8624999999999999e-05 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.455781+0000", 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0059e-05 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.455880+0000", 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8811e-05 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.349 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.455888+0000", 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3420000000000008e-06 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.458706+0000", 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002818213 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.458830+0000", 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0001236 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.350 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.460254+0000", 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014243560000000001 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.474696+0000", 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014442363 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.478706+0000", 2024-09-17T16:43:14.351 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0040091399999999996 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.478766+0000", 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0520000000000003e-05 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:725 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~704512] snapc 1f=[1e,1c,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:05.459018+0000", 2024-09-17T16:43:14.352 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7849591379999996, 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021314373000000001, 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 725 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.353 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.459018+0000", 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.459018+0000", 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.459019+0000", 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.533e-06 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.354 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.461020+0000", 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020011360000000001 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.461035+0000", 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5088e-05 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.461045+0000", 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3919999999999992e-06 2024-09-17T16:43:14.355 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.465918+0000", 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048731219999999997 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.465991+0000", 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3045000000000003e-05 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.356 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.466874+0000", 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00088314899999999996 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.475370+0000", 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084963839999999992 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.480265+0000", 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0048947840000000001 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.357 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.480332+0000", 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6740000000000001e-05 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:726 3.5s0 3:af4951e1:::smithi18337221-22:head [append 0~458752] snapc 1f=[1e,1c,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:05.461607+0000", 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7823697470000006, 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.018908379999999999, 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.358 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 726 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.461607+0000", 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.359 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.461607+0000", 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.461608+0000", 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.218e-06 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.360 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462468+0000", 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00086017999999999999 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462479+0000", 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0769e-05 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462486+0000", 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1199999999999996e-06 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.361 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.471187+0000", 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087011870000000009 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.471299+0000", 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011204 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.471981+0000", 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00068152800000000004 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.362 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.475885+0000", 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.003904037 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.480474+0000", 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0045893519999999997 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.480515+0000", 2024-09-17T16:43:14.363 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0948999999999997e-05 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:728 3.5s0 3:af4951e1:::smithi18337221-22:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:05.462530+0000", 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 8.7814465269999999, 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019274873000000001, 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:14.364 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 728 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462530+0000", 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462530+0000", 2024-09-17T16:43:14.365 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462531+0000", 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1999999999999999e-07 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462534+0000", 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9210000000000001e-06 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.366 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462541+0000", 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0400000000000004e-06 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.462546+0000", 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.164e-06 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.475418+0000", 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012871811 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.367 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.475483+0000", 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5332000000000004e-05 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.481069+0000", 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055858469999999997 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.481159+0000", 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0140000000000001e-05 2024-09-17T16:43:14.368 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:05.481805+0000", 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00064599799999999995 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.369 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.371 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:43:14.371 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:14.368+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:14.456 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:43:14.457 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.14 to 1 (10000) 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:341: done (2 left) 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:342: read oid 45 snap 33 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:342: expect deleted 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 15 current snap is 35 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:339: finishing copy_from to smithi18337221-50 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:339: got expected ENOENT (src dne) 2024-09-17T16:43:14.458 INFO:tasks.rados.rados.0.smithi183.stdout:343: seq_num 131 ranges {1900544=655360,2555904=425984,2981888=638976,3620864=491520} 2024-09-17T16:43:14.471 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:14.469+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:14.471 INFO:tasks.rados.rados.0.smithi183.stdout:343: writing smithi18337221-15 from 1900544 to 2555904 tid 1 2024-09-17T16:43:14.474 INFO:tasks.rados.rados.0.smithi183.stdout:343: writing smithi18337221-15 from 2555904 to 2981888 tid 2 2024-09-17T16:43:14.479 INFO:tasks.rados.rados.0.smithi183.stdout:343: writing smithi18337221-15 from 2981888 to 3620864 tid 3 2024-09-17T16:43:14.480 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.480 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:14.480 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:14.480 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.484 INFO:tasks.rados.rados.0.smithi183.stdout:343: writing smithi18337221-15 from 3620864 to 4112384 tid 4 2024-09-17T16:43:14.484 INFO:tasks.rados.rados.0.smithi183.stdout:344: read oid 5 snap -1 2024-09-17T16:43:14.484 INFO:tasks.rados.rados.0.smithi183.stdout:344: expect (ObjNum 129 snap 35 seq_num 129) 2024-09-17T16:43:14.484 INFO:tasks.rados.rados.0.smithi183.stdout:345: copy_from oid 21 from oid 27 current snap is 35 2024-09-17T16:43:14.484 INFO:tasks.rados.rados.0.smithi183.stdout:339: finishing copy_from racing read to smithi18337221-50 2024-09-17T16:43:14.484 INFO:tasks.rados.rados.0.smithi183.stdout:340: finishing copy_from racing read to smithi18337221-29 2024-09-17T16:43:14.485 INFO:tasks.rados.rados.0.smithi183.stdout:340: finishing copy_from to smithi18337221-29 2024-09-17T16:43:14.485 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 29 v 155 (ObjNum 101 snap 21 seq_num 101) dirty exists 2024-09-17T16:43:14.485 INFO:tasks.rados.rados.0.smithi183.stdout:339: done (5 left) 2024-09-17T16:43:14.485 INFO:tasks.rados.rados.0.smithi183.stdout:340: done (4 left) 2024-09-17T16:43:14.485 INFO:tasks.rados.rados.0.smithi183.stdout:342: done (3 left) 2024-09-17T16:43:14.486 INFO:tasks.rados.rados.0.smithi183.stdout:346: read oid 34 snap -1 2024-09-17T16:43:14.486 INFO:tasks.rados.rados.0.smithi183.stdout:346: expect (ObjNum 125 snap 33 seq_num 125) 2024-09-17T16:43:14.486 INFO:tasks.rados.rados.0.smithi183.stdout:347: copy_from oid 24 from oid 2 current snap is 35 2024-09-17T16:43:14.486 INFO:tasks.rados.rados.0.smithi183.stdout:348: copy_from oid 20 from oid 37 current snap is 35 2024-09-17T16:43:14.486 INFO:tasks.rados.rados.0.smithi183.stdout:349: read oid 12 snap 28 2024-09-17T16:43:14.487 INFO:tasks.rados.rados.0.smithi183.stdout:349: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:43:14.487 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 6 current snap is 35 2024-09-17T16:43:14.487 INFO:tasks.rados.rados.0.smithi183.stdout:350: seq_num 132 ranges {3932160=671744,4603904=573440,5177344=753664,5931008=229376} 2024-09-17T16:43:14.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-17T16:43:14.492 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:43:14.507 INFO:tasks.rados.rados.0.smithi183.stdout:350: writing smithi18337221-6 from 3932160 to 4603904 tid 1 2024-09-17T16:43:14.511 INFO:tasks.rados.rados.0.smithi183.stdout:350: writing smithi18337221-6 from 4603904 to 5177344 tid 2 2024-09-17T16:43:14.515 INFO:tasks.rados.rados.0.smithi183.stdout:350: writing smithi18337221-6 from 5177344 to 5931008 tid 3 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:350: writing smithi18337221-6 from 5931008 to 6160384 tid 4 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:351: copy_from oid 33 from oid 40 current snap is 35 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:345: finishing copy_from to smithi18337221-21 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:345: got expected ENOENT (src dne) 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:345: finishing copy_from racing read to smithi18337221-21 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:349: expect (ObjNum 11 snap 0 seq_num 11) 2024-09-17T16:43:14.518 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:14.520 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:14.522 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 107271 2024-09-17T16:43:14.523 INFO:tasks.rados.rados.0.smithi183.stdout:343: finishing write tid 1 to smithi18337221-15 2024-09-17T16:43:14.524 INFO:tasks.rados.rados.0.smithi183.stdout:343: finishing write tid 2 to smithi18337221-15 2024-09-17T16:43:14.524 INFO:tasks.rados.rados.0.smithi183.stdout:344: expect (ObjNum 129 snap 35 seq_num 129) 2024-09-17T16:43:14.524 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:14.547 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:14.567 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:14.573 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:14.570+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:14.593 INFO:tasks.rados.rados.0.smithi183.stdout:346: expect (ObjNum 125 snap 33 seq_num 125) 2024-09-17T16:43:14.593 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:14.602 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.602 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:14.602 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:14.602 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:14.602 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.611 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:43:14.632 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 2479937 2024-09-17T16:43:14.646 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 2261471 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: finishing write tid 3 to smithi18337221-15 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:347: finishing copy_from racing read to smithi18337221-24 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: finishing write tid 4 to smithi18337221-15 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: finishing write tid 5 to smithi18337221-15 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:347: finishing copy_from to smithi18337221-24 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 24 v 72 (ObjNum 82 snap 13 seq_num 82) dirty exists 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: finishing write tid 6 to smithi18337221-15 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: oid 15 updating version 0 to 198 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: oid 15 updating version 198 to 201 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: oid 15 version 201 is already newer than 199 2024-09-17T16:43:14.651 INFO:tasks.rados.rados.0.smithi183.stdout:343: oid 15 updating version 201 to 202 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:343: oid 15 version 202 is already newer than 200 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 202 (ObjNum 131 snap 35 seq_num 131) dirty exists 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:343: left oid 15 (ObjNum 131 snap 35 seq_num 131) 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:351: finishing copy_from racing read to smithi18337221-33 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:351: finishing copy_from to smithi18337221-33 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 6 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:350: finishing write tid 1 to smithi18337221-6 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:350: finishing write tid 2 to smithi18337221-6 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:350: finishing write tid 3 to smithi18337221-6 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:350: finishing write tid 4 to smithi18337221-6 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:350: finishing write tid 5 to smithi18337221-6 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:343: done (8 left) 2024-09-17T16:43:14.652 INFO:tasks.rados.rados.0.smithi183.stdout:344: done (7 left) 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:345: done (6 left) 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:346: done (5 left) 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:347: done (4 left) 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:349: done (3 left) 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:351: done (2 left) 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:352: rollback oid 33 current snap is 35 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 33 to 28 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:350: finishing write tid 6 to smithi18337221-6 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:350: oid 6 updating version 0 to 61 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:350: oid 6 updating version 61 to 62 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:350: oid 6 updating version 62 to 64 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:350: oid 6 version 64 is already newer than 60 2024-09-17T16:43:14.653 INFO:tasks.rados.rados.0.smithi183.stdout:350: oid 6 version 64 is already newer than 63 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 6 v 64 (ObjNum 132 snap 35 seq_num 132) dirty exists 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:350: left oid 6 (ObjNum 132 snap 35 seq_num 132) 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:348: finishing copy_from racing read to smithi18337221-20 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:348: finishing copy_from to smithi18337221-20 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 20 v 88 (ObjNum 122 snap 32 seq_num 122) dirty exists 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:348: done (2 left) 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:350: done (1 left) 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:353: delete oid 32 current snap is 35 2024-09-17T16:43:14.654 INFO:tasks.rados.rados.0.smithi183.stdout:352: finishing rollback tid 0 to smithi18337221-33 2024-09-17T16:43:14.655 INFO:tasks.rados.rados.0.smithi183.stdout:353: done (1 left) 2024-09-17T16:43:14.655 INFO:tasks.rados.rados.0.smithi183.stdout:354: snap_remove snap 24 2024-09-17T16:43:14.674 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:14.672+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:14.716 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.716 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:14.716 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:14.716 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:14.716 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.716 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 40/34 ECSubWrite(tid=13, reqid=client.4553.0:209, at_version=40'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.213297126999997, 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091284039999999997, 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.717 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500287+0000", 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500288+0000", 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8799999999999998e-07 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500609+0000", 2024-09-17T16:43:14.718 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000321482 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500624+0000", 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4558e-05 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500632+0000", 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9589999999999995e-06 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.719 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500693+0000", 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1045999999999998e-05 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500703+0000", 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9899999999999992e-06 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509375+0000", 2024-09-17T16:43:14.720 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0086724420000000007 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.509416+0000", 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0639000000000002e-05 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:14.721 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.190824782999997, 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010249355999999999, 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.722 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522760+0000", 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.2e-07 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.723 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523388+0000", 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062798599999999997 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523412+0000", 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3898999999999999e-05 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523422+0000", 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0259e-05 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.724 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523489+0000", 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7070000000000007e-05 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523500+0000", 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0617e-05 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.532963+0000", 2024-09-17T16:43:14.725 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009463183 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.533009+0000", 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5921999999999998e-05 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s1 50/34 ECSubWrite(tid=27, reqid=client.4553.0:297, at_version=50'16, trim_to=0'0, roll_forward_to=46'14))", 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:43:14.726 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.228453203999997, 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081612969999999996, 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.727 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485131+0000", 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485132+0000", 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5699999999999999e-07 2024-09-17T16:43:14.728 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485905+0000", 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00077313100000000004 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485917+0000", 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2092999999999999e-05 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.729 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485924+0000", 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7700000000000004e-06 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485987+0000", 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3487999999999999e-05 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.485998+0000", 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0917000000000001e-05 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.730 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493262+0000", 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072639489999999996 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.493293+0000", 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0791999999999999e-05 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.731 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=27, reqid=client.4553.0:372, at_version=55'21, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.198841020000003, 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014931335, 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.732 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.514744+0000", 2024-09-17T16:43:14.733 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.99e-07 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515242+0000", 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049758300000000001 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515257+0000", 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.502e-05 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.734 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515265+0000", 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.3440000000000001e-06 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515335+0000", 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9536000000000006e-05 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.515345+0000", 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9240000000000002e-06 2024-09-17T16:43:14.735 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529639+0000", 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014294526 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529675+0000", 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5703e-05 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.736 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=28, reqid=client.4553.0:373, at_version=55'22, trim_to=0'0, roll_forward_to=43'19))", 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.191819867, 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081458920000000001, 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:43:14.737 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521765+0000", 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.521766+0000", 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5700000000000001e-07 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.738 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522010+0000", 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00024482600000000002 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522025+0000", 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.484e-05 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522035+0000", 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000001e-06 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.739 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522101+0000", 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5848999999999999e-05 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.522111+0000", 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0122000000000001e-05 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529879+0000", 2024-09-17T16:43:14.740 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077677559999999998 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.529911+0000", 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1742000000000002e-05 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=34, reqid=client.4553.0:395, at_version=55'27, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:43:14.741 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.102188343000002, 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.008221562, 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611396+0000", 2024-09-17T16:43:14.742 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611397+0000", 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.71e-07 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611941+0000", 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000544269 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.743 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611963+0000", 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1710999999999999e-05 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611973+0000", 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612053+0000", 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0012999999999994e-05 2024-09-17T16:43:14.744 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.612087+0000", 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4171999999999997e-05 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619590+0000", 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075029110000000001 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.619618+0000", 2024-09-17T16:43:14.745 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7461999999999999e-05 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 55/34 ECSubWrite(tid=35, reqid=client.4553.0:396, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.095116658999999, 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0062462430000000003, 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.746 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618468+0000", 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.747 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618469+0000", 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7400000000000002e-07 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618513+0000", 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3862000000000001e-05 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618529+0000", 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6183000000000001e-05 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.748 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618538+0000", 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2280000000000004e-06 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618616+0000", 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8300999999999995e-05 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618627+0000", 2024-09-17T16:43:14.749 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0750999999999999e-05 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624677+0000", 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060503570000000001 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.624714+0000", 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6786999999999999e-05 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.750 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 45.221128274999998, 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079871060000000008, 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.751 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492456+0000", 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492457+0000", 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.58e-07 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.752 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492641+0000", 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000184215 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492656+0000", 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5279000000000001e-05 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492704+0000", 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7738000000000003e-05 2024-09-17T16:43:14.753 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492882+0000", 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000177906 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.492916+0000", 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4110999999999999e-05 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.754 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500404+0000", 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0074877750000000003 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:29.500443+0000", 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9724000000000001e-05 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:14.755 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.123949562, 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0099594590000000004, 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.756 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.589636+0000", 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.124e-06 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590162+0000", 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00052565200000000004 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.757 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590177+0000", 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5627000000000001e-05 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590187+0000", 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4439999999999997e-06 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590255+0000", 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7867000000000006e-05 2024-09-17T16:43:14.758 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.590264+0000", 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0799999999999995e-06 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599543+0000", 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009279374 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.599595+0000", 2024-09-17T16:43:14.759 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1291000000000001e-05 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.119264635999997, 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0065491719999999998, 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.760 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594320+0000", 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.761 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594321+0000", 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9000000000000005e-07 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594830+0000", 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050941699999999996 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594845+0000", 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4535999999999999e-05 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.762 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.594855+0000", 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0344e-05 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595268+0000", 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00041257099999999998 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.595278+0000", 2024-09-17T16:43:14.763 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.048e-05 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600836+0000", 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055574250000000004 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.600869+0000", 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3408999999999998e-05 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.764 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 62/34 ECSubWrite(tid=58, reqid=osd.0.0:58, at_version=62'53, trim_to=0'0, roll_forward_to=61'49))", 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.269987200000003, 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067202670000000003, 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.765 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443597+0000", 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443598+0000", 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.766 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443624+0000", 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5219999999999999e-05 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443638+0000", 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4470999999999999e-05 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.767 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.443647+0000", 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4199999999999996e-06 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444249+0000", 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060141600000000002 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.444255+0000", 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4080000000000003e-06 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.768 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450282+0000", 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060268819999999999 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.450318+0000", 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5553000000000003e-05 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.769 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.263767701999999, 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0075788619999999996, 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.770 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449817+0000", 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9599999999999999e-07 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449939+0000", 2024-09-17T16:43:14.771 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000122082 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449951+0000", 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.129e-05 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.449960+0000", 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4040000000000001e-06 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.772 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450024+0000", 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3781999999999993e-05 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.450034+0000", 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0039e-05 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457345+0000", 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073110359999999999 2024-09-17T16:43:14.773 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457396+0000", 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0732999999999997e-05 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.255673720000001, 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010715298, 2024-09-17T16:43:14.774 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457911+0000", 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.775 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.457912+0000", 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.15e-06 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458033+0000", 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000121348 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.776 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458055+0000", 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1265000000000001e-05 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458066+0000", 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1483e-05 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458134+0000", 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.7743000000000005e-05 2024-09-17T16:43:14.777 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458144+0000", 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0151e-05 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468594+0000", 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010449974000000001 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.778 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.468626+0000", 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2184000000000002e-05 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.5s3 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.250872196, 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087638739999999996, 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.779 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462712+0000", 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.780 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462724+0000", 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1761e-05 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462852+0000", 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00012799600000000001 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462869+0000", 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6850999999999998e-05 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.781 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462879+0000", 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.5400000000000001e-06 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462938+0000", 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9449e-05 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.462947+0000", 2024-09-17T16:43:14.782 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0909999999999999e-06 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471444+0000", 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084973329999999993 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.471476+0000", 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1853000000000001e-05 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.783 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.2375036, 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010450760999999999, 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.784 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476081+0000", 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.72e-07 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.785 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476564+0000", 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048279099999999999 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476577+0000", 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3351e-05 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.786 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476587+0000", 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8379999999999997e-06 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476667+0000", 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9798999999999999e-05 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.476680+0000", 2024-09-17T16:43:14.787 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2764e-05 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486459+0000", 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0097787150000000003 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:49.486532+0000", 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3231000000000004e-05 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.788 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 91/77 ECSubWrite(tid=124, reqid=osd.14.0:124, at_version=91'41, trim_to=0'0, roll_forward_to=85'39))", 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.457912+0000", 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.255672938, 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0081718050000000007, 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.789 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.457912+0000", 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.457912+0000", 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.457912+0000", 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.41e-07 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.790 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.457940+0000", 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8138999999999999e-05 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.457954+0000", 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4293e-05 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.457966+0000", 2024-09-17T16:43:14.791 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1919999999999999e-05 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458047+0000", 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1062000000000004e-05 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458060+0000", 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2103000000000001e-05 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.792 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.465998+0000", 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079384380000000008 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466083+0000", 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5508999999999997e-05 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.793 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.ds4 91/77 ECSubWrite(tid=329, reqid=osd.4.0:329, at_version=91'16, trim_to=0'0, roll_forward_to=90'14))", 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.459293+0000", 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.254291846999999, 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010804895, 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459293+0000", 2024-09-17T16:43:14.794 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459293+0000", 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459293+0000", 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1099999999999996e-07 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.795 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459315+0000", 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1982000000000001e-05 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459325+0000", 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0042e-05 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.796 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459334+0000", 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1859999999999998e-06 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459412+0000", 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7673e-05 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459425+0000", 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2500999999999999e-05 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.797 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470049+0000", 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010624771999999999 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470098+0000", 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8228e-05 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.798 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.0s2 91/77 ECSubWrite(tid=125, reqid=osd.14.0:125, at_version=91'43, trim_to=0'0, roll_forward_to=85'39))", 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.459374+0000", 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.254210174000001, 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010756566, 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.799 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459374+0000", 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459374+0000", 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459375+0000", 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4799999999999999e-07 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.800 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459411+0000", 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5947e-05 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459419+0000", 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.405e-06 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459426+0000", 2024-09-17T16:43:14.801 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0389999999999999e-06 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459615+0000", 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018842899999999999 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459621+0000", 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2149999999999998e-06 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.802 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470075+0000", 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010454239000000001 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470131+0000", 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.5844000000000003e-05 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.803 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.6s5 91/34 ECSubWrite(tid=86, reqid=osd.0.0:85, at_version=0'0, trim_to=0'0, roll_forward_to=91'76))", 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.463839+0000", 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.249745473000001, 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063354329999999997, 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463839+0000", 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.804 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463839+0000", 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463840+0000", 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6299999999999993e-07 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463852+0000", 2024-09-17T16:43:14.805 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.182e-05 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463866+0000", 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4069e-05 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463875+0000", 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.132e-06 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.806 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463943+0000", 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8341000000000002e-05 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463955+0000", 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1338999999999999e-05 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470092+0000", 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061368619999999999 2024-09-17T16:43:14.807 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470175+0000", 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2906999999999998e-05 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.ds4 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:14.513657+0000", 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.199928104, 2024-09-17T16:43:14.808 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.033002720999999999, 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.513657+0000", 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.513657+0000", 2024-09-17T16:43:14.809 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.513657+0000", 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6e-07 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.518308+0000", 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0046513270000000002 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:14.810 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.518319+0000", 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0716999999999999e-05 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.518325+0000", 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.421e-06 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.518375+0000", 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9489e-05 2024-09-17T16:43:14.811 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.518381+0000", 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.601e-06 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.546628+0000", 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028246277 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:14.812 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.546659+0000", 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.1628999999999998e-05 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:14.813 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.814 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:43:14.815 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:14.812+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:14.915 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:14.913+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:14.917 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:14.917 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:14.917 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:14.926 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:43:15.016 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:15.014+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:15.027 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:15.027 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:15.028 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:15.035 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:43:15.118 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:15.115+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:15.140 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:259 3.as0 3:50831259:::smithi18337221-29:head [append 0~638976] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.630248866999999, 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.022736635000000002, 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.141 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 259 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.142 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507570+0000", 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.507573+0000", 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2400000000000002e-06 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508317+0000", 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00074403399999999997 2024-09-17T16:43:15.143 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508341+0000", 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4454999999999999e-05 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508353+0000", 2024-09-17T16:43:15.144 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2255e-05 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508427+0000", 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3428000000000002e-05 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "op must wait for map", 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.508437+0000", 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8279999999999998e-06 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.145 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510471+0000", 2024-09-17T16:43:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0020343150000000001 2024-09-17T16:43:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.146 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510530+0000", 2024-09-17T16:43:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9429999999999999e-05 2024-09-17T16:43:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511483+0000", 2024-09-17T16:43:15.147 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000952596 2024-09-17T16:43:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522459+0000", 2024-09-17T16:43:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010975805 2024-09-17T16:43:15.148 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530227+0000", 2024-09-17T16:43:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077686020000000003 2024-09-17T16:43:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.149 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530307+0000", 2024-09-17T16:43:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9647000000000005e-05 2024-09-17T16:43:15.150 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:260 3.as0 3:50831259:::smithi18337221-29:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:15.151 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:43:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.628258940999999, 2024-09-17T16:43:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020894380000000001, 2024-09-17T16:43:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.152 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 260 2024-09-17T16:43:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.153 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:43:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.154 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509560+0000", 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.155 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.509561+0000", 2024-09-17T16:43:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0470000000000001e-06 2024-09-17T16:43:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.156 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510123+0000", 2024-09-17T16:43:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00056148700000000005 2024-09-17T16:43:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510133+0000", 2024-09-17T16:43:15.157 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.025e-05 2024-09-17T16:43:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510140+0000", 2024-09-17T16:43:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0129999999999996e-06 2024-09-17T16:43:15.158 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519266+0000", 2024-09-17T16:43:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0091254409999999998 2024-09-17T16:43:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.159 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519325+0000", 2024-09-17T16:43:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.9122000000000001e-05 2024-09-17T16:43:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.160 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.519798+0000", 2024-09-17T16:43:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00047354100000000001 2024-09-17T16:43:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.161 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523708+0000", 2024-09-17T16:43:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0039092340000000001 2024-09-17T16:43:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.162 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530404+0000", 2024-09-17T16:43:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066966009999999999 2024-09-17T16:43:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.163 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530455+0000", 2024-09-17T16:43:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0643999999999998e-05 2024-09-17T16:43:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.164 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:261 3.as0 3:50831259:::smithi18337221-29:head [setxattr _header (56) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:43:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.627666411, 2024-09-17T16:43:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020439715000000001, 2024-09-17T16:43:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.165 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.166 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 261 2024-09-17T16:43:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.167 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:43:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.168 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510153+0000", 2024-09-17T16:43:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.169 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510154+0000", 2024-09-17T16:43:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.16e-07 2024-09-17T16:43:15.170 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510157+0000", 2024-09-17T16:43:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5949999999999999e-06 2024-09-17T16:43:15.171 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510163+0000", 2024-09-17T16:43:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.993e-06 2024-09-17T16:43:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.172 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510168+0000", 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8620000000000002e-06 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522482+0000", 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012313691 2024-09-17T16:43:15.173 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522554+0000", 2024-09-17T16:43:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1983999999999994e-05 2024-09-17T16:43:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.174 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522957+0000", 2024-09-17T16:43:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00040297599999999999 2024-09-17T16:43:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.175 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.524157+0000", 2024-09-17T16:43:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0011998950000000001 2024-09-17T16:43:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.176 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:43:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0063637449999999996 2024-09-17T16:43:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.177 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530593+0000", 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2157999999999996e-05 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.178 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:262 3.as0 3:50831259:::smithi18337221-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.627643976999998, 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021519231999999999, 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 262 2024-09-17T16:43:15.179 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510175+0000", 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.180 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510176+0000", 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4700000000000002e-07 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510178+0000", 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9649999999999998e-06 2024-09-17T16:43:15.181 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510184+0000", 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2489999999999998e-06 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.510189+0000", 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.9649999999999999e-06 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.182 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523572+0000", 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013382955 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523660+0000", 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8460000000000003e-05 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.530953+0000", 2024-09-17T16:43:15.183 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0072929079999999999 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.531043+0000", 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9289000000000005e-05 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.184 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.531695+0000", 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00065199400000000003 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.3s3 46/34 ECSubWrite(tid=19, reqid=client.4553.0:270, at_version=46'12, trim_to=0'0, roll_forward_to=43'10))", 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 55.614977390999996, 2024-09-17T16:43:15.185 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011272473, 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.186 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.522842+0000", 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.48e-07 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523557+0000", 2024-09-17T16:43:15.187 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00071461699999999996 2024-09-17T16:43:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523570+0000", 2024-09-17T16:43:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2876e-05 2024-09-17T16:43:15.188 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523578+0000", 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2339999999999994e-06 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.189 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523644+0000", 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.6023000000000001e-05 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.523653+0000", 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9570000000000008e-06 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.190 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.534081+0000", 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010428031000000001 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.534114+0000", 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3487e-05 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.191 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 51.676528867999998, 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011363906, 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:15.192 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461290+0000", 2024-09-17T16:43:15.193 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461291+0000", 2024-09-17T16:43:15.194 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3700000000000001e-07 2024-09-17T16:43:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461780+0000", 2024-09-17T16:43:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048932100000000003 2024-09-17T16:43:15.195 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461798+0000", 2024-09-17T16:43:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7643999999999999e-05 2024-09-17T16:43:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.196 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461808+0000", 2024-09-17T16:43:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0628000000000001e-05 2024-09-17T16:43:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.197 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461901+0000", 2024-09-17T16:43:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2238999999999996e-05 2024-09-17T16:43:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.198 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.461919+0000", 2024-09-17T16:43:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8389999999999998e-05 2024-09-17T16:43:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.199 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.472621+0000", 2024-09-17T16:43:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010701965000000001 2024-09-17T16:43:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.200 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.472654+0000", 2024-09-17T16:43:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3382e-05 2024-09-17T16:43:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.201 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.cs2 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.651398385999997, 2024-09-17T16:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.009062779, 2024-09-17T16:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.202 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.203 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486421+0000", 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.204 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486422+0000", 2024-09-17T16:43:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1900000000000001e-07 2024-09-17T16:43:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.205 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486443+0000", 2024-09-17T16:43:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1484999999999998e-05 2024-09-17T16:43:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.206 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486460+0000", 2024-09-17T16:43:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6645000000000001e-05 2024-09-17T16:43:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.207 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486467+0000", 2024-09-17T16:43:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4499999999999998e-06 2024-09-17T16:43:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486524+0000", 2024-09-17T16:43:15.208 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7099999999999999e-05 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.486531+0000", 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3160000000000002e-06 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.209 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.495444+0000", 2024-09-17T16:43:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0089135640000000006 2024-09-17T16:43:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.210 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.495484+0000", 2024-09-17T16:43:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9400000000000002e-05 2024-09-17T16:43:15.211 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.215 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:386 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~524288] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.541277272000002, 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014318277000000001, 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.216 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 386 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596542+0000", 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.217 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.596544+0000", 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.734e-06 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597029+0000", 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048475200000000002 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.218 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597043+0000", 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4173e-05 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597050+0000", 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2640000000000002e-06 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597102+0000", 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1535e-05 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.219 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597175+0000", 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3429000000000005e-05 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598023+0000", 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00084855 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610455+0000", 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012431143 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.220 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610790+0000", 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00033497699999999997 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610860+0000", 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0720000000000001e-05 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.221 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:387 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~524288] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.538240723000001, 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.014991211000000001, 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 387 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.222 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599579+0000", 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.223 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.599580+0000", 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.291e-06 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600184+0000", 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060389600000000003 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.224 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600201+0000", 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.681e-05 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600209+0000", 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5609999999999999e-06 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604101+0000", 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0038916070000000001 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.225 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604228+0000", 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000126787 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.605024+0000", 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00079670200000000004 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.610981+0000", 2024-09-17T16:43:15.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059569289999999997 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614498+0000", 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0035168930000000001 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614570+0000", 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1735000000000004e-05 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:388 3.as0 3:53f17c76:::smithi18337221-27:head [append 0~245760] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.536883768999999, 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016358692000000001, 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 388 2024-09-17T16:43:15.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600936+0000", 2024-09-17T16:43:15.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.600937+0000", 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9099999999999991e-07 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601238+0000", 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00030118700000000002 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601251+0000", 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2916e-05 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601258+0000", 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.2840000000000001e-06 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611153+0000", 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0098949710000000007 2024-09-17T16:43:15.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611232+0000", 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8889999999999999e-05 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.611928+0000", 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00069601799999999996 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614731+0000", 2024-09-17T16:43:15.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0028030020000000002 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617241+0000", 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025097890000000001 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617294+0000", 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3643999999999997e-05 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:389 3.as0 3:53f17c76:::smithi18337221-27:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.536549655000002, 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.016157145000000001, 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 389 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.234 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601270+0000", 2024-09-17T16:43:15.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.92e-07 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601274+0000", 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3289999999999998e-06 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601282+0000", 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2009999999999999e-06 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.236 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601288+0000", 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5300000000000002e-06 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.613675+0000", 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012386642 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.613763+0000", 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7653999999999998e-05 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614215+0000", 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000451939 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.616836+0000", 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002621483 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617370+0000", 2024-09-17T16:43:15.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000534243 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617427+0000", 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6431999999999998e-05 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.239 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:390 3.as0 3:53f17c76:::smithi18337221-27:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.536523574, 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017251170999999999, 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 390 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.240 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601296+0000", 2024-09-17T16:43:15.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4000000000000002e-07 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601298+0000", 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.2859999999999998e-06 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601306+0000", 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6820000000000003e-06 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.601311+0000", 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0869999999999997e-06 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614799+0000", 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013488061000000001 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.614854+0000", 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4469000000000003e-05 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617735+0000", 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002881125 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.617783+0000", 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7617999999999997e-05 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.618547+0000", 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00076440299999999998 2024-09-17T16:43:15.244 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.1s1 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 41.61894195, 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012458881, 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518877+0000", 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.518878+0000", 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2900000000000003e-07 2024-09-17T16:43:15.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519191+0000", 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000313271 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519201+0000", 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8900000000000002e-06 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519206+0000", 2024-09-17T16:43:15.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.1340000000000003e-06 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519254+0000", 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7649999999999999e-05 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.519264+0000", 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0309000000000001e-05 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.531316+0000", 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012051976000000001 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:33.531336+0000", 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.0021999999999999e-05 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.249 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.cs2 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:35.452541+0000", 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 39.685277964999997, 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012693558000000001, 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452541+0000", 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452541+0000", 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452542+0000", 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8500000000000002e-07 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452798+0000", 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00025625099999999998 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452813+0000", 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.468e-05 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.452821+0000", 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0290000000000005e-06 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.453090+0000", 2024-09-17T16:43:15.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000269294 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.453102+0000", 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2362e-05 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.465196+0000", 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012094077 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:35.465235+0000", 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8479999999999997e-05 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:501 3.as0 3:5b2a661d:::smithi18337221-31:head [append 0~753664] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.451672+0000", 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.686147298000002, 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.019340112, 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 501 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.451672+0000", 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.451672+0000", 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.451673+0000", 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4649999999999999e-06 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453004+0000", 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0013307810000000001 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453020+0000", 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6141999999999999e-05 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453030+0000", 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0068000000000001e-05 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453078+0000", 2024-09-17T16:43:15.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.7042000000000001e-05 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.453147+0000", 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9129999999999997e-05 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.454127+0000", 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098032700000000002 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467347+0000", 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013219684000000001 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.470950+0000", 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0036033940000000002 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471012+0000", 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.2079e-05 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.259 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:502 3.as0 3:5b2a661d:::smithi18337221-31:head [append 0~720896] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.455702+0000", 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.682117798, 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.015930025, 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.260 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 502 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.455702+0000", 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.455702+0000", 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.455704+0000", 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6299999999999998e-06 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456465+0000", 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000760906 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456480+0000", 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4671999999999999e-05 2024-09-17T16:43:15.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456488+0000", 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2369999999999992e-06 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462008+0000", 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055201190000000004 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462099+0000", 2024-09-17T16:43:15.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0882000000000002e-05 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.462955+0000", 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00085584699999999997 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469310+0000", 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006355126 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471591+0000", 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.002280621 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471632+0000", 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.0985000000000001e-05 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:503 3.as0 3:5b2a661d:::smithi18337221-31:head [append 0~49152] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:43:15.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.456509+0000", 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.681309857999999, 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.017705940999999999, 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 503 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456509+0000", 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456509+0000", 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456510+0000", 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6800000000000009e-07 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456539+0000", 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.8476e-05 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456548+0000", 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6710000000000005e-06 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456557+0000", 2024-09-17T16:43:15.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.3649999999999993e-06 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467364+0000", 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.010807173 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467428+0000", 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3936999999999994e-05 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.467913+0000", 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00048495500000000002 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469445+0000", 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0015320760000000001 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.474171+0000", 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0047256700000000004 2024-09-17T16:43:15.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.474215+0000", 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4650000000000001e-05 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:504 3.as0 3:5b2a661d:::smithi18337221-31:head [setxattr _header (57) in=7b] snapc 10=[10,f] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.456564+0000", 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.681255168, 2024-09-17T16:43:15.271 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.020464788000000001, 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 504 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456564+0000", 2024-09-17T16:43:15.272 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456564+0000", 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456565+0000", 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8700000000000001e-07 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.273 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456566+0000", 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9319999999999999e-06 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456570+0000", 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5480000000000002e-06 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456573+0000", 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9720000000000001e-06 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.274 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.468615+0000", 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012041559 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.468733+0000", 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00011834500000000001 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469118+0000", 2024-09-17T16:43:15.275 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00038559599999999999 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.471393+0000", 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0022749060000000002 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.476977+0000", 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055831839999999997 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.276 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.477029+0000", 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.2358999999999998e-05 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:505 3.as0 3:5b2a661d:::smithi18337221-31:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e65)", 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 36.681242613000002, 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.021479267, 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.277 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "started", 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 505 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.278 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456577+0000", 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7599999999999998e-07 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456580+0000", 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.5940000000000001e-06 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.279 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456585+0000", 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0540000000000002e-06 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.456588+0000", 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.881e-06 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469636+0000", 2024-09-17T16:43:15.280 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.013048844 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.469690+0000", 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3695e-05 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.477362+0000", 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0076723879999999996 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.281 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.477450+0000", 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.7482e-05 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:38.478056+0000", 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00060605299999999995 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:552 3.as0 3:53f17c76:::smithi18337221-27:head [delete] snapc 14=[14,13,f] ondisk+write+known_if_redirected+full_force+supports_pool_eio e72)", 2024-09-17T16:43:15.282 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:45.454621+0000", 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 29.683198591, 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0093139629999999998, 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 552 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:15.283 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454621+0000", 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454621+0000", 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454623+0000", 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.17e-06 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.284 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454631+0000", 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.6990000000000003e-06 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454647+0000", 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6509999999999999e-05 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454656+0000", 2024-09-17T16:43:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5269999999999998e-06 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454729+0000", 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3616999999999997e-05 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "started", 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.454842+0000", 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000113133 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.455830+0000", 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00098809700000000006 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.458218+0000", 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0023873940000000001 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "commit_sent", 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.463842+0000", 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0056238850000000003 2024-09-17T16:43:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:45.463935+0000", 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2930999999999995e-05 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:15.288 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:15.290 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:43:15.290 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:15.287+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:15.390 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:15.388+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:15.404 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:15.404 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:15.404 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:15.404 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:15.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:43:15.448 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.15 to 1 (10000) 2024-09-17T16:43:15.451 INFO:tasks.rados.rados.0.smithi183.stdout:354: done (1 left) 2024-09-17T16:43:15.451 INFO:tasks.rados.rados.0.smithi183.stdout:355: snap_remove snap 17 2024-09-17T16:43:15.463 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T16:43:15.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:43:15.491 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:15.488+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:15.568 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:15.568 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:15.568 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:15.568 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:15.568 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:15.577 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:43:15.592 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:15.589+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:15.681 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:15.681 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:288 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.219815742000002, 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018124781, 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.682 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 288 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.683 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458512+0000", 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.201e-06 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459021+0000", 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000508696 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.684 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459036+0000", 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4946000000000001e-05 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459044+0000", 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2330000000000006e-06 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.685 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459105+0000", 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2959999999999998e-06 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467231+0000", 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081265810000000008 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467343+0000", 2024-09-17T16:43:15.686 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111366 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.468193+0000", 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085095400000000001 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472015+0000", 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038219119999999998 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.687 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476572+0000", 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045570619999999997 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476636+0000", 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3184999999999999e-05 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.688 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:289 3.es0 3:7af0cf48:::smithi18337221-43:head [setxattr _header (56) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.219262960000002, 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017770232, 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 289 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.689 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:15.690 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5199999999999996e-07 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459069+0000", 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459077+0000", 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.691 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459083+0000", 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3620000000000002e-06 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459130+0000", 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6876000000000003e-05 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459135+0000", 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3340000000000003e-06 2024-09-17T16:43:15.692 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471144+0000", 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012009117999999999 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471236+0000", 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2281999999999995e-05 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.693 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471658+0000", 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042205299999999998 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472216+0000", 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055826699999999999 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476768+0000", 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045520710000000004 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.694 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476834+0000", 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5445999999999996e-05 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:290 3.es0 3:7af0cf48:::smithi18337221-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.219227828999998, 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021360535999999999, 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.695 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 290 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.696 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.697 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459107+0000", 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2930000000000003e-06 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459115+0000", 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.208e-06 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459121+0000", 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.698 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459161+0000", 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9637e-05 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459168+0000", 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3000000000000004e-06 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471869+0000", 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012700899 2024-09-17T16:43:15.699 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471947+0000", 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8330000000000004e-05 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477178+0000", 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052311160000000001 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.700 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477230+0000", 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1366999999999998e-05 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.480459+0000", 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032295029999999999 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:353 3.es0 3:7af0cf48:::smithi18337221-43:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:43:15.701 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.198814245999998, 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030354281, 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 353 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.702 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479514+0000", 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4649999999999999e-06 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.703 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479520+0000", 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7910000000000001e-06 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479530+0000", 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0753e-05 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479539+0000", 2024-09-17T16:43:15.704 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9260000000000006e-06 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479975+0000", 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043575500000000002 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480105+0000", 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013020600000000001 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.705 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490191+0000", 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010086247 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501337+0000", 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011145446999999999 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509772+0000", 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084349049999999995 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.706 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509867+0000", 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4785999999999997e-05 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:355 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~475136] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.190226177, 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022143336, 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.707 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 355 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.708 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488102+0000", 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1119999999999999e-06 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488993+0000", 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089148899999999998 2024-09-17T16:43:15.709 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489004+0000", 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1270000000000001e-05 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489012+0000", 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9729999999999997e-06 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495281+0000", 2024-09-17T16:43:15.710 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062688559999999997 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495381+0000", 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100233 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496316+0000", 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093481 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.711 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509884+0000", 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013567932 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510170+0000", 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028624299999999999 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510244+0000", 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3417999999999994e-05 2024-09-17T16:43:15.712 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:356 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~622592] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.186175951000003, 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01999051, 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.713 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 356 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:43:15.714 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492153+0000", 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.911e-06 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492881+0000", 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072854300000000001 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.715 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492894+0000", 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2435e-05 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492902+0000", 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-06 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501528+0000", 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086269080000000008 2024-09-17T16:43:15.716 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501643+0000", 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011425399999999999 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502627+0000", 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098378000000000007 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.717 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509887+0000", 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072604310000000003 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512095+0000", 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022076079999999998 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512141+0000", 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6570999999999998e-05 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.718 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:357 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~147456] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.185408893999998, 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020343033999999999, 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 357 2024-09-17T16:43:15.719 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.720 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8800000000000002e-07 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492986+0000", 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7827e-05 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492993+0000", 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8709999999999999e-06 2024-09-17T16:43:15.721 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492999+0000", 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6500000000000001e-06 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507458+0000", 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014459013999999999 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507570+0000", 2024-09-17T16:43:15.722 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011199199999999999 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.508224+0000", 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065380799999999997 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510045+0000", 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018218609999999999 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.723 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513184+0000", 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031387979999999999 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513261+0000", 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:358 3.es0 3:7858efeb:::smithi18337221-46:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.724 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.185318170999999, 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020438640000000001, 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.725 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 358 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.726 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493009+0000", 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493012+0000", 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8150000000000002e-06 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493019+0000", 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3490000000000003e-06 2024-09-17T16:43:15.727 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493024+0000", 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8690000000000003e-06 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510349+0000", 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017324736 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.728 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510406+0000", 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7293000000000002e-05 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510704+0000", 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000298101 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511712+0000", 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001008227 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.729 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513366+0000", 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016533780000000001 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513447+0000", 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1322000000000005e-05 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.730 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:359 3.es0 3:7858efeb:::smithi18337221-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.185294792000001, 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021336417999999999, 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:15.731 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 359 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.732 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.34e-07 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.733 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493036+0000", 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8010000000000001e-06 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493041+0000", 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9910000000000002e-06 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493046+0000", 2024-09-17T16:43:15.734 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8409999999999999e-06 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511258+0000", 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018211793 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511428+0000", 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017049099999999999 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.735 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513824+0000", 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002395533 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513926+0000", 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102079 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.514368+0000", 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044245500000000002 2024-09-17T16:43:15.736 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:360 3.es0 3:78f58299:::smithi18337221-26:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.185273780999999, 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028558304999999999, 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.737 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 360 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:15.738 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.46e-07 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493057+0000", 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9099999999999998e-06 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.739 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493062+0000", 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5530000000000003e-06 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493066+0000", 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5719999999999996e-06 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511762+0000", 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018695494 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.740 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511863+0000", 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010166999999999999 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.515440+0000", 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003576419 2024-09-17T16:43:15.741 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517437+0000", 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019973209999999998 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521513+0000", 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040760140000000002 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.742 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521611+0000", 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7905999999999994e-05 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:361 3.es0 3:78f58299:::smithi18337221-26:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 47.185253674999998, 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024151737999999999, 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.743 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 361 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.744 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7899999999999999e-07 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493075+0000", 2024-09-17T16:43:15.745 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1090000000000001e-06 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493082+0000", 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4749999999999998e-06 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493087+0000", 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6829999999999999e-06 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.746 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512244+0000", 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019157789000000001 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512274+0000", 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258e-05 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517080+0000", 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004806495 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.747 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517152+0000", 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1958000000000005e-05 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517225+0000", 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2491999999999996e-05 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.748 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:643 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~442368] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.473523+0000", 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.204803385999998, 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017311680999999999, 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 643 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.749 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.473523+0000", 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.473523+0000", 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.473524+0000", 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4499999999999996e-07 2024-09-17T16:43:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.474101+0000", 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057721400000000005 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.474112+0000", 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0793e-05 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.751 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.474118+0000", 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6130000000000003e-06 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.478934+0000", 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048165889999999996 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.479031+0000", 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6887999999999998e-05 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.752 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.479736+0000", 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070506099999999999 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.487089+0000", 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073526370000000004 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.490791+0000", 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037018609999999999 2024-09-17T16:43:15.753 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.490835+0000", 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4180000000000001e-05 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:692 3.es0 3:7af0cf48:::smithi18337221-43:head [copy-from ver 16] snapc 1c=[1c,1b,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.515291+0000", 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.163035288, 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018399011999999999, 2024-09-17T16:43:15.754 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 692 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515291+0000", 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.755 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515291+0000", 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515293+0000", 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.756 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515311+0000", 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8142999999999999e-05 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515327+0000", 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5993000000000001e-05 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515355+0000", 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7702999999999999e-05 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.757 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515419+0000", 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3849000000000005e-05 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515424+0000", 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.383e-06 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.517533+0000", 2024-09-17T16:43:15.758 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021093409999999998 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.517614+0000", 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0729000000000006e-05 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.525523+0000", 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079089090000000004 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.759 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.531946+0000", 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064228159999999996 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.533592+0000", 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016461239999999999 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.533690+0000", 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8252999999999996e-05 2024-09-17T16:43:15.760 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:807 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~475136] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.457620+0000", 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2207061980000002, 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019394886, 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.761 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 807 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.457620+0000", 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.457620+0000", 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.762 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.457621+0000", 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.458052+0000", 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043095200000000002 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.763 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.458064+0000", 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2129e-05 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.458071+0000", 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5050000000000004e-06 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463301+0000", 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052301379999999996 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.764 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463416+0000", 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114893 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464210+0000", 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079383299999999997 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471172+0000", 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069623209999999996 2024-09-17T16:43:15.765 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.476937+0000", 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057652800000000002 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477015+0000", 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8110999999999998e-05 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.766 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:808 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~507904] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.460524+0000", 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2178030599999996, 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022637039000000001, 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 808 2024-09-17T16:43:15.767 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.460524+0000", 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.460524+0000", 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.768 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.460525+0000", 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0410000000000001e-06 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.461192+0000", 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066739999999999996 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.461202+0000", 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.769 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.461210+0000", 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0099999999999995e-06 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.467195+0000", 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059850800000000003 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.770 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.467290+0000", 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5002999999999998e-05 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.468018+0000", 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072738800000000004 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471484+0000", 2024-09-17T16:43:15.771 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034666609999999998 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483111+0000", 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011626377 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483161+0000", 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9913000000000001e-05 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.772 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:809 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~475136] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.463552+0000", 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2147742509999997, 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019738499999999999, 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.773 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 809 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463552+0000", 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463552+0000", 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.774 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463553+0000", 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8100000000000001e-07 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464060+0000", 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050633099999999995 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464067+0000", 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5870000000000004e-06 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464072+0000", 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4989999999999996e-06 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471591+0000", 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075197079999999999 2024-09-17T16:43:15.776 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471688+0000", 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6704000000000001e-05 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.472440+0000", 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075215099999999995 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.476728+0000", 2024-09-17T16:43:15.777 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042878660000000004 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483239+0000", 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065110039999999999 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483291+0000", 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1669000000000003e-05 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.778 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:810 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~98304] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2142200189999999, 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019486518000000001, 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 810 2024-09-17T16:43:15.779 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9699999999999996e-07 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464232+0000", 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124793 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464243+0000", 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.781 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464248+0000", 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7790000000000003e-06 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.475401+0000", 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011153450000000001 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.475455+0000", 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3538000000000001e-05 2024-09-17T16:43:15.782 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.475812+0000", 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035700800000000002 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477773+0000", 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019608109999999998 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483554+0000", 2024-09-17T16:43:15.783 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00578095 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483593+0000", 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9415999999999997e-05 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:811 3.es0 3:7ab49360:::smithi18337221-34:head [setxattr _header (57) in=7b] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.464259+0000", 2024-09-17T16:43:15.784 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2140672009999998, 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019819531000000001, 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.785 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464259+0000", 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464259+0000", 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464260+0000", 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4999999999999998e-07 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.786 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464262+0000", 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1280000000000002e-06 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464266+0000", 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0829999999999997e-06 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464271+0000", 2024-09-17T16:43:15.787 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3360000000000002e-06 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477061+0000", 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012790045 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477119+0000", 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7927999999999998e-05 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.788 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477426+0000", 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030643199999999998 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477916+0000", 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00049028899999999998 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484022+0000", 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061061020000000004 2024-09-17T16:43:15.789 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484079+0000", 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6737999999999998e-05 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:812 3.es0 3:7ab49360:::smithi18337221-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.2140479859999997, 2024-09-17T16:43:15.790 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020852448999999999, 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 812 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:15.791 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0299999999999999e-07 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.792 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464282+0000", 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4569999999999999e-06 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464288+0000", 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0120000000000002e-06 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464293+0000", 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2989999999999996e-06 2024-09-17T16:43:15.793 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477803+0000", 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013510543999999999 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477904+0000", 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100907 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484392+0000", 2024-09-17T16:43:15.794 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064879050000000004 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484448+0000", 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6224000000000002e-05 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.485131+0000", 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068259799999999997 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.795 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.ds6 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.512841+0000", 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 1.165485884, 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.036902873000000003, 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.512841+0000", 2024-09-17T16:43:15.796 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.512841+0000", 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.512842+0000", 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.018e-06 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517597+0000", 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047555540000000004 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517613+0000", 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5617999999999999e-05 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517622+0000", 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0270000000000001e-06 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.798 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517705+0000", 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3067999999999998e-05 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517717+0000", 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.163e-05 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.549709+0000", 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03199196 2024-09-17T16:43:15.799 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.549744+0000", 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4997999999999999e-05 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:15.800 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:15.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:43:15.802 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:15.799+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:15.806 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:43:15.807 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:43:15.818 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-17T16:43:15.447281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":99549747,"num_objects":98,"num_object_clones":48,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":7,"num_read":485,"num_read_kb":112071,"num_write":917,"num_write_kb":119368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":46961203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1260,"ondisk_log_size":1260,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":636324,"kb_used_data":172616,"kb_used_omap":23,"kb_used_meta":463336,"kb_avail":1414941276,"statfs":{"total":1449551462400,"available":1448899866624,"internally_reserved":0,"allocated":176758784,"data_stored":224818130,"data_compressed":2247648,"data_compressed_allocated":4587520,"data_compressed_original":10080256,"omap_allocated":23926,"internal_metadata":474456714},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22609920,"num_objects":14,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":24,"num_read_kb":8007,"num_write":68,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997137"},"pg_stats":[{"pgid":"3.f","version":"95'28","reported_seq":145,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.457157+0000","last_change":"2024-09-17T16:43:09.457767+0000","last_active":"2024-09-17T16:43:12.457157+0000","last_peered":"2024-09-17T16:43:12.457157+0000","last_clean":"2024-09-17T16:43:12.457157+0000","last_became_active":"2024-09-17T16:42:51.465295+0000","last_became_peered":"2024-09-17T16:42:51.465295+0000","last_unstale":"2024-09-17T16:43:12.457157+0000","last_undegraded":"2024-09-17T16:43:12.457157+0000","last_fullsized":"2024-09-17T16:43:12.457157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:32.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013669559999999999,"stat_sum":{"num_bytes":638976,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1542,"num_write":24,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":638976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,14,11,7,10,0],"acting":[4,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.e","version":"97'122","reported_seq":467,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.453801+0000","last_change":"2024-09-17T16:43:09.471151+0000","last_active":"2024-09-17T16:43:12.453801+0000","last_peered":"2024-09-17T16:43:12.453801+0000","last_clean":"2024-09-17T16:43:12.453801+0000","last_became_active":"2024-09-17T16:42:51.455767+0000","last_became_peered":"2024-09-17T16:42:51.455767+0000","last_unstale":"2024-09-17T16:43:12.453801+0000","last_undegraded":"2024-09-17T16:43:12.453801+0000","last_fullsized":"2024-09-17T16:43:12.453801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:18.129038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015287129,"stat_sum":{"num_bytes":7553024,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":28,"num_read_kb":3701,"num_write":60,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1785856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,1,8,6,12],"acting":[2,11,5,1,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.d","version":"95'20","reported_seq":146,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.457061+0000","last_change":"2024-09-17T16:43:09.482437+0000","last_active":"2024-09-17T16:43:12.457061+0000","last_peered":"2024-09-17T16:43:12.457061+0000","last_clean":"2024-09-17T16:43:12.457061+0000","last_became_active":"2024-09-17T16:42:51.464621+0000","last_became_peered":"2024-09-17T16:42:51.464621+0000","last_unstale":"2024-09-17T16:43:12.457061+0000","last_undegraded":"2024-09-17T16:43:12.457061+0000","last_fullsized":"2024-09-17T16:43:12.457061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:14.953950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025057370999999998,"stat_sum":{"num_bytes":671744,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":9,"num_read_kb":699,"num_write":25,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,14,10,9,8,2],"acting":[4,1,14,10,9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.c","version":"101'201","reported_seq":621,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T16:43:14.656458+0000","last_change":"2024-09-17T16:43:14.458365+0000","last_active":"2024-09-17T16:43:14.656458+0000","last_peered":"2024-09-17T16:43:14.656458+0000","last_clean":"2024-09-17T16:43:14.656458+0000","last_became_active":"2024-09-17T16:42:54.483633+0000","last_became_peered":"2024-09-17T16:42:54.483633+0000","last_unstale":"2024-09-17T16:43:14.656458+0000","last_undegraded":"2024-09-17T16:43:14.656458+0000","last_fullsized":"2024-09-17T16:43:14.656458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:25.596552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081808499999999997,"stat_sum":{"num_bytes":14729216,"num_objects":12,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":83,"num_read_kb":25031,"num_write":170,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":19496960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,0,10,6,12,3],"acting":[5,8,0,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"3"},{"start":"24","length":"1"}]},{"pgid":"3.b","version":"97'134","reported_seq":448,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.456725+0000","last_change":"2024-09-17T16:43:09.481608+0000","last_active":"2024-09-17T16:43:12.456725+0000","last_peered":"2024-09-17T16:43:12.456725+0000","last_clean":"2024-09-17T16:43:12.456725+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:43:12.456725+0000","last_undegraded":"2024-09-17T16:43:12.456725+0000","last_fullsized":"2024-09-17T16:43:12.456725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:36.026859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024577618999999998,"stat_sum":{"num_bytes":12320768,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":37,"num_read_kb":9980,"num_write":49,"num_write_kb":15616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.a","version":"99'65","reported_seq":167,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.527585+0000","last_change":"2024-09-17T16:43:09.453048+0000","last_active":"2024-09-17T16:43:12.527585+0000","last_peered":"2024-09-17T16:43:12.527585+0000","last_clean":"2024-09-17T16:43:12.527585+0000","last_became_active":"2024-09-17T16:42:51.457245+0000","last_became_peered":"2024-09-17T16:42:51.457245+0000","last_unstale":"2024-09-17T16:43:12.527585+0000","last_undegraded":"2024-09-17T16:43:12.527585+0000","last_fullsized":"2024-09-17T16:43:12.527585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:19.794041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060926399999999999,"stat_sum":{"num_bytes":7274496,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":23,"num_read_kb":9728,"num_write":48,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5472256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7,5,14,6,10],"acting":[8,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.9","version":"95'62","reported_seq":368,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.481627+0000","last_change":"2024-09-17T16:43:09.463101+0000","last_active":"2024-09-17T16:43:10.481627+0000","last_peered":"2024-09-17T16:43:10.481627+0000","last_clean":"2024-09-17T16:43:10.481627+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:43:10.481627+0000","last_undegraded":"2024-09-17T16:43:10.481627+0000","last_fullsized":"2024-09-17T16:43:10.481627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:20.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057958700000000001,"stat_sum":{"num_bytes":1720320,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":20,"num_read_kb":5251,"num_write":37,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.8","version":"95'48","reported_seq":366,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460886+0000","last_change":"2024-09-17T16:43:09.463337+0000","last_active":"2024-09-17T16:43:10.460886+0000","last_peered":"2024-09-17T16:43:10.460886+0000","last_clean":"2024-09-17T16:43:10.460886+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:43:10.460886+0000","last_undegraded":"2024-09-17T16:43:10.460886+0000","last_fullsized":"2024-09-17T16:43:10.460886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:27.698208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002353356,"stat_sum":{"num_bytes":1835008,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":8173,"num_write":74,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"1.0","version":"24'92","reported_seq":157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460696+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:43:10.460696+0000","last_peered":"2024-09-17T16:43:10.460696+0000","last_clean":"2024-09-17T16:43:10.460696+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:43:10.460696+0000","last_undegraded":"2024-09-17T16:43:10.460696+0000","last_fullsized":"2024-09-17T16:43:10.460696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:06.994581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":153,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460719+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:43:10.460719+0000","last_peered":"2024-09-17T16:43:10.460719+0000","last_clean":"2024-09-17T16:43:10.460719+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:43:10.460719+0000","last_undegraded":"2024-09-17T16:43:10.460719+0000","last_fullsized":"2024-09-17T16:43:10.460719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":316,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460826+0000","last_change":"2024-09-17T16:43:09.462642+0000","last_active":"2024-09-17T16:43:10.460826+0000","last_peered":"2024-09-17T16:43:10.460826+0000","last_clean":"2024-09-17T16:43:10.460826+0000","last_became_active":"2024-09-17T16:42:51.456757+0000","last_became_peered":"2024-09-17T16:42:51.456757+0000","last_unstale":"2024-09-17T16:43:10.460826+0000","last_undegraded":"2024-09-17T16:43:10.460826+0000","last_fullsized":"2024-09-17T16:43:10.460826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:29.057449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9,1,5,3,7],"acting":[11,2,9,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.494571+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:43:12.494571+0000","last_peered":"2024-09-17T16:43:12.494571+0000","last_clean":"2024-09-17T16:43:12.494571+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:43:12.494571+0000","last_undegraded":"2024-09-17T16:43:12.494571+0000","last_fullsized":"2024-09-17T16:43:12.494571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"99'72","reported_seq":424,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.463525+0000","last_change":"2024-09-17T16:43:09.491248+0000","last_active":"2024-09-17T16:43:12.463525+0000","last_peered":"2024-09-17T16:43:12.463525+0000","last_clean":"2024-09-17T16:43:12.463525+0000","last_became_active":"2024-09-17T16:42:51.464941+0000","last_became_peered":"2024-09-17T16:42:51.464941+0000","last_unstale":"2024-09-17T16:43:12.463525+0000","last_undegraded":"2024-09-17T16:43:12.463525+0000","last_fullsized":"2024-09-17T16:43:12.463525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:34.136416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034716195999999998,"stat_sum":{"num_bytes":6897664,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":3217,"num_write":68,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5505024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15,3,11,10,2,7],"acting":[4,15,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T16:43:11.448546+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:43:11.448546+0000","last_peered":"2024-09-17T16:43:11.448546+0000","last_clean":"2024-09-17T16:43:11.448546+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:43:11.448546+0000","last_undegraded":"2024-09-17T16:43:11.448546+0000","last_fullsized":"2024-09-17T16:43:11.448546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"96'56","reported_seq":381,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.482213+0000","last_change":"2024-09-17T16:43:09.475628+0000","last_active":"2024-09-17T16:43:10.482213+0000","last_peered":"2024-09-17T16:43:10.482213+0000","last_clean":"2024-09-17T16:43:10.482213+0000","last_became_active":"2024-09-17T16:42:51.458212+0000","last_became_peered":"2024-09-17T16:42:51.458212+0000","last_unstale":"2024-09-17T16:43:10.482213+0000","last_undegraded":"2024-09-17T16:43:10.482213+0000","last_fullsized":"2024-09-17T16:43:10.482213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:28.321290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01298739,"stat_sum":{"num_bytes":6389760,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":2761,"num_write":25,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3358720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,8,11,4],"acting":[14,2,9,3,8,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.2","version":"30'2","reported_seq":72,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.461029+0000","last_change":"2024-09-17T16:42:51.461863+0000","last_active":"2024-09-17T16:43:10.461029+0000","last_peered":"2024-09-17T16:43:10.461029+0000","last_clean":"2024-09-17T16:43:10.461029+0000","last_became_active":"2024-09-17T16:42:51.453441+0000","last_became_peered":"2024-09-17T16:42:51.453441+0000","last_unstale":"2024-09-17T16:43:10.461029+0000","last_undegraded":"2024-09-17T16:43:10.461029+0000","last_fullsized":"2024-09-17T16:43:10.461029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:15.542278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"3.3","version":"96'44","reported_seq":390,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T16:43:11.448576+0000","last_change":"2024-09-17T16:43:09.474063+0000","last_active":"2024-09-17T16:43:11.448576+0000","last_peered":"2024-09-17T16:43:11.448576+0000","last_clean":"2024-09-17T16:43:11.448576+0000","last_became_active":"2024-09-17T16:42:51.458671+0000","last_became_peered":"2024-09-17T16:42:51.458671+0000","last_unstale":"2024-09-17T16:43:11.448576+0000","last_undegraded":"2024-09-17T16:43:11.448576+0000","last_fullsized":"2024-09-17T16:43:11.448576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:28.812900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01146233,"stat_sum":{"num_bytes":4046848,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":26,"num_read_kb":3202,"num_write":19,"num_write_kb":4464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4046848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,3,2,10,5],"acting":[15,9,4,3,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.5","version":"101'83","reported_seq":418,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T16:43:14.488053+0000","last_change":"2024-09-17T16:43:14.464780+0000","last_active":"2024-09-17T16:43:14.488053+0000","last_peered":"2024-09-17T16:43:14.488053+0000","last_clean":"2024-09-17T16:43:14.488053+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:43:14.488053+0000","last_undegraded":"2024-09-17T16:43:14.488053+0000","last_fullsized":"2024-09-17T16:43:14.488053+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:37.057295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0071061589999999999,"stat_sum":{"num_bytes":6848512,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":7743,"num_write":50,"num_write_kb":8608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"3"},{"start":"24","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460850+0000","last_change":"2024-09-17T16:42:45.450049+0000","last_active":"2024-09-17T16:43:10.460850+0000","last_peered":"2024-09-17T16:43:10.460850+0000","last_clean":"2024-09-17T16:43:10.460850+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:43:10.460850+0000","last_undegraded":"2024-09-17T16:43:10.460850+0000","last_fullsized":"2024-09-17T16:43:10.460850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:23.869155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'48","reported_seq":370,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.480657+0000","last_change":"2024-09-17T16:43:09.453081+0000","last_active":"2024-09-17T16:43:12.480657+0000","last_peered":"2024-09-17T16:43:12.480657+0000","last_clean":"2024-09-17T16:43:12.480657+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:43:12.480657+0000","last_undegraded":"2024-09-17T16:43:12.480657+0000","last_fullsized":"2024-09-17T16:43:12.480657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:35.666896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059065599999999995,"stat_sum":{"num_bytes":5062656,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":23,"num_read_kb":9524,"num_write":22,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460551+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:43:10.460551+0000","last_peered":"2024-09-17T16:43:10.460551+0000","last_clean":"2024-09-17T16:43:10.460551+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:43:10.460551+0000","last_undegraded":"2024-09-17T16:43:10.460551+0000","last_fullsized":"2024-09-17T16:43:10.460551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"99'98","reported_seq":440,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.496271+0000","last_change":"2024-09-17T16:43:09.469184+0000","last_active":"2024-09-17T16:43:12.496271+0000","last_peered":"2024-09-17T16:43:12.496271+0000","last_clean":"2024-09-17T16:43:12.496271+0000","last_became_active":"2024-09-17T16:42:51.461192+0000","last_became_peered":"2024-09-17T16:42:51.461192+0000","last_unstale":"2024-09-17T16:43:12.496271+0000","last_undegraded":"2024-09-17T16:43:12.496271+0000","last_fullsized":"2024-09-17T16:43:12.496271+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:26.608294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012417360000000001,"stat_sum":{"num_bytes":13778944,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":10166,"num_write":79,"num_write_kb":14640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5111808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,14],"acting":[4,6,7,0,11,10,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.480524+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:43:12.480524+0000","last_peered":"2024-09-17T16:43:12.480524+0000","last_clean":"2024-09-17T16:43:12.480524+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:43:12.480524+0000","last_undegraded":"2024-09-17T16:43:12.480524+0000","last_fullsized":"2024-09-17T16:43:12.480524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:05.616046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"96'84","reported_seq":398,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.473014+0000","last_change":"2024-09-17T16:43:09.465415+0000","last_active":"2024-09-17T16:43:12.473014+0000","last_peered":"2024-09-17T16:43:12.473014+0000","last_clean":"2024-09-17T16:43:12.473014+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:43:12.473014+0000","last_undegraded":"2024-09-17T16:43:12.473014+0000","last_fullsized":"2024-09-17T16:43:12.473014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:25.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092912140000000008,"stat_sum":{"num_bytes":9191424,"num_objects":7,"num_object_clones":4,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":18,"num_read_kb":11289,"num_write":42,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.472227+0000","last_change":"2024-09-17T16:42:51.455625+0000","last_active":"2024-09-17T16:43:10.472227+0000","last_peered":"2024-09-17T16:43:10.472227+0000","last_clean":"2024-09-17T16:43:10.472227+0000","last_became_active":"2024-09-17T16:42:51.455329+0000","last_became_peered":"2024-09-17T16:42:51.455329+0000","last_unstale":"2024-09-17T16:43:10.472227+0000","last_undegraded":"2024-09-17T16:43:10.472227+0000","last_fullsized":"2024-09-17T16:43:10.472227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:15.543997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":98959360,"num_objects":94,"num_object_clones":48,"num_object_copies":658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":7,"num_read":409,"num_read_kb":112007,"num_write":792,"num_write_kb":117216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":46432256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165806080,"data_stored":221667328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1165,"ondisk_log_size":1165,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182422,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38904,"kb_used_data":7716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332936,"statfs":{"total":96636764160,"available":96596926464,"internally_reserved":0,"allocated":7901184,"data_stored":10056062,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182422,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40352,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331488,"statfs":{"total":96636764160,"available":96595443712,"internally_reserved":0,"allocated":9375744,"data_stored":12636542,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182422,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":16176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":16564224,"data_stored":22295454,"data_compressed":154955,"data_compressed_allocated":331776,"data_compressed_original":1122304,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280532,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46584,"kb_used_data":15392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325256,"statfs":{"total":96636764160,"available":96589062144,"internally_reserved":0,"allocated":15761408,"data_stored":19560884,"data_compressed":149759,"data_compressed_allocated":303104,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":0,"seq":94489280532,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280532,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":8924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":9138176,"data_stored":12168148,"data_compressed":156211,"data_compressed_allocated":335872,"data_compressed_original":1118208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280532,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":13568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":13893632,"data_stored":17357236,"data_compressed":149759,"data_compressed_allocated":303104,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313237,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44364,"kb_used_data":13168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327476,"statfs":{"total":96636764160,"available":96591335424,"internally_reserved":0,"allocated":13484032,"data_stored":16876010,"data_compressed":151832,"data_compressed_allocated":307200,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313237,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34776,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337064,"statfs":{"total":96636764160,"available":96601153536,"internally_reserved":0,"allocated":7929856,"data_stored":11182570,"data_compressed":151832,"data_compressed_allocated":307200,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247830,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45264,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326576,"statfs":{"total":96636764160,"available":96590413824,"internally_reserved":0,"allocated":14409728,"data_stored":17615448,"data_compressed":153903,"data_compressed_allocated":311296,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,6,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215123,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":6800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":6963200,"data_stored":7973073,"data_compressed":145609,"data_compressed_allocated":294912,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215126,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45984,"kb_used_data":14796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325856,"statfs":{"total":96636764160,"available":96589676544,"internally_reserved":0,"allocated":15151104,"data_stored":18956670,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215125,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44800,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327040,"statfs":{"total":96636764160,"available":96590888960,"internally_reserved":0,"allocated":13930496,"data_stored":18217150,"data_compressed":145609,"data_compressed_allocated":294912,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215125,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45620,"kb_used_data":10272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326220,"statfs":{"total":96636764160,"available":96590049280,"internally_reserved":0,"allocated":10518528,"data_stored":12382609,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182422,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40552,"kb_used_data":9360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331288,"statfs":{"total":96636764160,"available":96595238912,"internally_reserved":0,"allocated":9584640,"data_stored":12057012,"data_compressed":149759,"data_compressed_allocated":303104,"data_compressed_original":606208,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182420,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43056,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328784,"statfs":{"total":96636764160,"available":96592674816,"internally_reserved":0,"allocated":12152832,"data_stored":15483262,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15712256,"data_stored":20299776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6914048,"data_stored":8359936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":11161600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8454144,"data_stored":11223040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":18452480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13254656,"data_stored":17182720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":18132992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11034624,"data_stored":14659584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12341248,"data_stored":16031744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":6787072,"data_stored":10338304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":12824576,"data_stored":17403904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":15405056,"data_stored":20942848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":9396224,"data_stored":11558912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":2809856,"data_stored":4874240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":8257536,"data_stored":11812864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":6782976,"data_stored":9232384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:43:15.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:43:15.903 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:15.901+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:15.905 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:15.906 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:15.906 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:15.906 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:15.914 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:43:15.952 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:16.004 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:16.001+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:16.057 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:16.058 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:16.058 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:16.058 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:16.058 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:16.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:43:16.079 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:16.079 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:16.097 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:16.107 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:16.105+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:16.114 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:16.114 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:16.131 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:16.131 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:16.149 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:16.149 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:16.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:43:16.160 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:43:16.166 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:16.166 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:16.172 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-17T16:43:15.447281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":99549747,"num_objects":98,"num_object_clones":48,"num_object_copies":666,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":7,"num_read":485,"num_read_kb":112071,"num_write":917,"num_write_kb":119368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":81,"num_bytes_recovered":46961203,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1260,"ondisk_log_size":1260,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":636324,"kb_used_data":172616,"kb_used_omap":23,"kb_used_meta":463336,"kb_avail":1414941276,"statfs":{"total":1449551462400,"available":1448899866624,"internally_reserved":0,"allocated":176758784,"data_stored":224818130,"data_compressed":2247648,"data_compressed_allocated":4587520,"data_compressed_original":10080256,"omap_allocated":23926,"internal_metadata":474456714},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22609920,"num_objects":14,"num_object_clones":13,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":24,"num_read_kb":8007,"num_write":68,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997137"},"pg_stats":[{"pgid":"3.f","version":"95'28","reported_seq":145,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.457157+0000","last_change":"2024-09-17T16:43:09.457767+0000","last_active":"2024-09-17T16:43:12.457157+0000","last_peered":"2024-09-17T16:43:12.457157+0000","last_clean":"2024-09-17T16:43:12.457157+0000","last_became_active":"2024-09-17T16:42:51.465295+0000","last_became_peered":"2024-09-17T16:42:51.465295+0000","last_unstale":"2024-09-17T16:43:12.457157+0000","last_undegraded":"2024-09-17T16:43:12.457157+0000","last_fullsized":"2024-09-17T16:43:12.457157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:32.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013669559999999999,"stat_sum":{"num_bytes":638976,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1542,"num_write":24,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":638976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,14,11,7,10,0],"acting":[4,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.e","version":"97'122","reported_seq":467,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.453801+0000","last_change":"2024-09-17T16:43:09.471151+0000","last_active":"2024-09-17T16:43:12.453801+0000","last_peered":"2024-09-17T16:43:12.453801+0000","last_clean":"2024-09-17T16:43:12.453801+0000","last_became_active":"2024-09-17T16:42:51.455767+0000","last_became_peered":"2024-09-17T16:42:51.455767+0000","last_unstale":"2024-09-17T16:43:12.453801+0000","last_undegraded":"2024-09-17T16:43:12.453801+0000","last_fullsized":"2024-09-17T16:43:12.453801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:18.129038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015287129,"stat_sum":{"num_bytes":7553024,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":28,"num_read_kb":3701,"num_write":60,"num_write_kb":11520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1785856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,1,8,6,12],"acting":[2,11,5,1,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.d","version":"95'20","reported_seq":146,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.457061+0000","last_change":"2024-09-17T16:43:09.482437+0000","last_active":"2024-09-17T16:43:12.457061+0000","last_peered":"2024-09-17T16:43:12.457061+0000","last_clean":"2024-09-17T16:43:12.457061+0000","last_became_active":"2024-09-17T16:42:51.464621+0000","last_became_peered":"2024-09-17T16:42:51.464621+0000","last_unstale":"2024-09-17T16:43:12.457061+0000","last_undegraded":"2024-09-17T16:43:12.457061+0000","last_fullsized":"2024-09-17T16:43:12.457061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:14.953950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025057370999999998,"stat_sum":{"num_bytes":671744,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":9,"num_read_kb":699,"num_write":25,"num_write_kb":656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1015808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,14,10,9,8,2],"acting":[4,1,14,10,9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.c","version":"101'201","reported_seq":621,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T16:43:14.656458+0000","last_change":"2024-09-17T16:43:14.458365+0000","last_active":"2024-09-17T16:43:14.656458+0000","last_peered":"2024-09-17T16:43:14.656458+0000","last_clean":"2024-09-17T16:43:14.656458+0000","last_became_active":"2024-09-17T16:42:54.483633+0000","last_became_peered":"2024-09-17T16:42:54.483633+0000","last_unstale":"2024-09-17T16:43:14.656458+0000","last_undegraded":"2024-09-17T16:43:14.656458+0000","last_fullsized":"2024-09-17T16:43:14.656458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:25.596552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00081808499999999997,"stat_sum":{"num_bytes":14729216,"num_objects":12,"num_object_clones":5,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":83,"num_read_kb":25031,"num_write":170,"num_write_kb":17728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":19496960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,0,10,6,12,3],"acting":[5,8,0,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"3"},{"start":"24","length":"1"}]},{"pgid":"3.b","version":"97'134","reported_seq":448,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.456725+0000","last_change":"2024-09-17T16:43:09.481608+0000","last_active":"2024-09-17T16:43:12.456725+0000","last_peered":"2024-09-17T16:43:12.456725+0000","last_clean":"2024-09-17T16:43:12.456725+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:43:12.456725+0000","last_undegraded":"2024-09-17T16:43:12.456725+0000","last_fullsized":"2024-09-17T16:43:12.456725+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:36.026859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024577618999999998,"stat_sum":{"num_bytes":12320768,"num_objects":9,"num_object_clones":4,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":37,"num_read_kb":9980,"num_write":49,"num_write_kb":15616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.a","version":"99'65","reported_seq":167,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.527585+0000","last_change":"2024-09-17T16:43:09.453048+0000","last_active":"2024-09-17T16:43:12.527585+0000","last_peered":"2024-09-17T16:43:12.527585+0000","last_clean":"2024-09-17T16:43:12.527585+0000","last_became_active":"2024-09-17T16:42:51.457245+0000","last_became_peered":"2024-09-17T16:42:51.457245+0000","last_unstale":"2024-09-17T16:43:12.527585+0000","last_undegraded":"2024-09-17T16:43:12.527585+0000","last_fullsized":"2024-09-17T16:43:12.527585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:19.794041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060926399999999999,"stat_sum":{"num_bytes":7274496,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":23,"num_read_kb":9728,"num_write":48,"num_write_kb":9088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5472256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,7,5,14,6,10],"acting":[8,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.9","version":"95'62","reported_seq":368,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.481627+0000","last_change":"2024-09-17T16:43:09.463101+0000","last_active":"2024-09-17T16:43:10.481627+0000","last_peered":"2024-09-17T16:43:10.481627+0000","last_clean":"2024-09-17T16:43:10.481627+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:43:10.481627+0000","last_undegraded":"2024-09-17T16:43:10.481627+0000","last_fullsized":"2024-09-17T16:43:10.481627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:20.317400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057958700000000001,"stat_sum":{"num_bytes":1720320,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":20,"num_read_kb":5251,"num_write":37,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.8","version":"95'48","reported_seq":366,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460886+0000","last_change":"2024-09-17T16:43:09.463337+0000","last_active":"2024-09-17T16:43:10.460886+0000","last_peered":"2024-09-17T16:43:10.460886+0000","last_clean":"2024-09-17T16:43:10.460886+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:43:10.460886+0000","last_undegraded":"2024-09-17T16:43:10.460886+0000","last_fullsized":"2024-09-17T16:43:10.460886+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:27.698208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002353356,"stat_sum":{"num_bytes":1835008,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":8173,"num_write":74,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"1.0","version":"24'92","reported_seq":157,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460696+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:43:10.460696+0000","last_peered":"2024-09-17T16:43:10.460696+0000","last_clean":"2024-09-17T16:43:10.460696+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:43:10.460696+0000","last_undegraded":"2024-09-17T16:43:10.460696+0000","last_fullsized":"2024-09-17T16:43:10.460696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:06.994581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":153,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460719+0000","last_change":"2024-09-17T16:41:58.309304+0000","last_active":"2024-09-17T16:43:10.460719+0000","last_peered":"2024-09-17T16:43:10.460719+0000","last_clean":"2024-09-17T16:43:10.460719+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:43:10.460719+0000","last_undegraded":"2024-09-17T16:43:10.460719+0000","last_fullsized":"2024-09-17T16:43:10.460719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:22.564482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":316,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460826+0000","last_change":"2024-09-17T16:43:09.462642+0000","last_active":"2024-09-17T16:43:10.460826+0000","last_peered":"2024-09-17T16:43:10.460826+0000","last_clean":"2024-09-17T16:43:10.460826+0000","last_became_active":"2024-09-17T16:42:51.456757+0000","last_became_peered":"2024-09-17T16:42:51.456757+0000","last_unstale":"2024-09-17T16:43:10.460826+0000","last_undegraded":"2024-09-17T16:43:10.460826+0000","last_fullsized":"2024-09-17T16:43:10.460826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:29.057449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014862790000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9,1,5,3,7],"acting":[11,2,9,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":156,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.494571+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:43:12.494571+0000","last_peered":"2024-09-17T16:43:12.494571+0000","last_clean":"2024-09-17T16:43:12.494571+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:43:12.494571+0000","last_undegraded":"2024-09-17T16:43:12.494571+0000","last_fullsized":"2024-09-17T16:43:12.494571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"99'72","reported_seq":424,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.463525+0000","last_change":"2024-09-17T16:43:09.491248+0000","last_active":"2024-09-17T16:43:12.463525+0000","last_peered":"2024-09-17T16:43:12.463525+0000","last_clean":"2024-09-17T16:43:12.463525+0000","last_became_active":"2024-09-17T16:42:51.464941+0000","last_became_peered":"2024-09-17T16:42:51.464941+0000","last_unstale":"2024-09-17T16:43:12.463525+0000","last_undegraded":"2024-09-17T16:43:12.463525+0000","last_fullsized":"2024-09-17T16:43:12.463525+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:34.136416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034716195999999998,"stat_sum":{"num_bytes":6897664,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":3217,"num_write":68,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5505024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,15,3,11,10,2,7],"acting":[4,15,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":152,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T16:43:11.448546+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:43:11.448546+0000","last_peered":"2024-09-17T16:43:11.448546+0000","last_clean":"2024-09-17T16:43:11.448546+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:43:11.448546+0000","last_undegraded":"2024-09-17T16:43:11.448546+0000","last_fullsized":"2024-09-17T16:43:11.448546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"96'56","reported_seq":381,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.482213+0000","last_change":"2024-09-17T16:43:09.475628+0000","last_active":"2024-09-17T16:43:10.482213+0000","last_peered":"2024-09-17T16:43:10.482213+0000","last_clean":"2024-09-17T16:43:10.482213+0000","last_became_active":"2024-09-17T16:42:51.458212+0000","last_became_peered":"2024-09-17T16:42:51.458212+0000","last_unstale":"2024-09-17T16:43:10.482213+0000","last_undegraded":"2024-09-17T16:43:10.482213+0000","last_fullsized":"2024-09-17T16:43:10.482213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:28.321290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01298739,"stat_sum":{"num_bytes":6389760,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":2761,"num_write":25,"num_write_kb":6240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":3358720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,8,11,4],"acting":[14,2,9,3,8,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.2","version":"30'2","reported_seq":72,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.461029+0000","last_change":"2024-09-17T16:42:51.461863+0000","last_active":"2024-09-17T16:43:10.461029+0000","last_peered":"2024-09-17T16:43:10.461029+0000","last_clean":"2024-09-17T16:43:10.461029+0000","last_became_active":"2024-09-17T16:42:51.453441+0000","last_became_peered":"2024-09-17T16:42:51.453441+0000","last_unstale":"2024-09-17T16:43:10.461029+0000","last_undegraded":"2024-09-17T16:43:10.461029+0000","last_fullsized":"2024-09-17T16:43:10.461029+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:15.542278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,1],"acting":[12,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"3.3","version":"96'44","reported_seq":390,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T16:43:11.448576+0000","last_change":"2024-09-17T16:43:09.474063+0000","last_active":"2024-09-17T16:43:11.448576+0000","last_peered":"2024-09-17T16:43:11.448576+0000","last_clean":"2024-09-17T16:43:11.448576+0000","last_became_active":"2024-09-17T16:42:51.458671+0000","last_became_peered":"2024-09-17T16:42:51.458671+0000","last_unstale":"2024-09-17T16:43:11.448576+0000","last_undegraded":"2024-09-17T16:43:11.448576+0000","last_fullsized":"2024-09-17T16:43:11.448576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:28.812900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01146233,"stat_sum":{"num_bytes":4046848,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":26,"num_read_kb":3202,"num_write":19,"num_write_kb":4464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4046848,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,3,2,10,5],"acting":[15,9,4,3,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"3.5","version":"101'83","reported_seq":418,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T16:43:14.488053+0000","last_change":"2024-09-17T16:43:14.464780+0000","last_active":"2024-09-17T16:43:14.488053+0000","last_peered":"2024-09-17T16:43:14.488053+0000","last_clean":"2024-09-17T16:43:14.488053+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:43:14.488053+0000","last_undegraded":"2024-09-17T16:43:14.488053+0000","last_fullsized":"2024-09-17T16:43:14.488053+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:37.057295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0071061589999999999,"stat_sum":{"num_bytes":6848512,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":7743,"num_write":50,"num_write_kb":8608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"3"},{"start":"24","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460850+0000","last_change":"2024-09-17T16:42:45.450049+0000","last_active":"2024-09-17T16:43:10.460850+0000","last_peered":"2024-09-17T16:43:10.460850+0000","last_clean":"2024-09-17T16:43:10.460850+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:43:10.460850+0000","last_undegraded":"2024-09-17T16:43:10.460850+0000","last_fullsized":"2024-09-17T16:43:10.460850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:23.869155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"99'48","reported_seq":370,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.480657+0000","last_change":"2024-09-17T16:43:09.453081+0000","last_active":"2024-09-17T16:43:12.480657+0000","last_peered":"2024-09-17T16:43:12.480657+0000","last_clean":"2024-09-17T16:43:12.480657+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:43:12.480657+0000","last_undegraded":"2024-09-17T16:43:12.480657+0000","last_fullsized":"2024-09-17T16:43:12.480657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:35.666896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059065599999999995,"stat_sum":{"num_bytes":5062656,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":23,"num_read_kb":9524,"num_write":22,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":160,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.460551+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:43:10.460551+0000","last_peered":"2024-09-17T16:43:10.460551+0000","last_clean":"2024-09-17T16:43:10.460551+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:43:10.460551+0000","last_undegraded":"2024-09-17T16:43:10.460551+0000","last_fullsized":"2024-09-17T16:43:10.460551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"99'98","reported_seq":440,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.496271+0000","last_change":"2024-09-17T16:43:09.469184+0000","last_active":"2024-09-17T16:43:12.496271+0000","last_peered":"2024-09-17T16:43:12.496271+0000","last_clean":"2024-09-17T16:43:12.496271+0000","last_became_active":"2024-09-17T16:42:51.461192+0000","last_became_peered":"2024-09-17T16:42:51.461192+0000","last_unstale":"2024-09-17T16:43:12.496271+0000","last_undegraded":"2024-09-17T16:43:12.496271+0000","last_fullsized":"2024-09-17T16:43:12.496271+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:26.608294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012417360000000001,"stat_sum":{"num_bytes":13778944,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":10166,"num_write":79,"num_write_kb":14640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5111808,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,14],"acting":[4,6,7,0,11,10,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":155,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.480524+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:43:12.480524+0000","last_peered":"2024-09-17T16:43:12.480524+0000","last_clean":"2024-09-17T16:43:12.480524+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:43:12.480524+0000","last_undegraded":"2024-09-17T16:43:12.480524+0000","last_fullsized":"2024-09-17T16:43:12.480524+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:05.616046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"96'84","reported_seq":398,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-09-17T16:43:12.473014+0000","last_change":"2024-09-17T16:43:09.465415+0000","last_active":"2024-09-17T16:43:12.473014+0000","last_peered":"2024-09-17T16:43:12.473014+0000","last_clean":"2024-09-17T16:43:12.473014+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:43:12.473014+0000","last_undegraded":"2024-09-17T16:43:12.473014+0000","last_fullsized":"2024-09-17T16:43:12.473014+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:25.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092912140000000008,"stat_sum":{"num_bytes":9191424,"num_objects":7,"num_object_clones":4,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":18,"num_read_kb":11289,"num_write":42,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"19","length":"1"},{"start":"1f","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-17T16:43:10.472227+0000","last_change":"2024-09-17T16:42:51.455625+0000","last_active":"2024-09-17T16:43:10.472227+0000","last_peered":"2024-09-17T16:43:10.472227+0000","last_clean":"2024-09-17T16:43:10.472227+0000","last_became_active":"2024-09-17T16:42:51.455329+0000","last_became_peered":"2024-09-17T16:42:51.455329+0000","last_unstale":"2024-09-17T16:43:10.472227+0000","last_undegraded":"2024-09-17T16:43:10.472227+0000","last_fullsized":"2024-09-17T16:43:10.472227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:15.543997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":98959360,"num_objects":94,"num_object_clones":48,"num_object_copies":658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":7,"num_read":409,"num_read_kb":112007,"num_write":792,"num_write_kb":117216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":78,"num_bytes_recovered":46432256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165806080,"data_stored":221667328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1165,"ondisk_log_size":1165,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182422,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38904,"kb_used_data":7716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332936,"statfs":{"total":96636764160,"available":96596926464,"internally_reserved":0,"allocated":7901184,"data_stored":10056062,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,6,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182422,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40352,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331488,"statfs":{"total":96636764160,"available":96595443712,"internally_reserved":0,"allocated":9375744,"data_stored":12636542,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182422,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47364,"kb_used_data":16176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324476,"statfs":{"total":96636764160,"available":96588263424,"internally_reserved":0,"allocated":16564224,"data_stored":22295454,"data_compressed":154955,"data_compressed_allocated":331776,"data_compressed_original":1122304,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280532,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46584,"kb_used_data":15392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325256,"statfs":{"total":96636764160,"available":96589062144,"internally_reserved":0,"allocated":15761408,"data_stored":19560884,"data_compressed":149759,"data_compressed_allocated":303104,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":0,"seq":94489280532,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280532,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":8924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":9138176,"data_stored":12168148,"data_compressed":156211,"data_compressed_allocated":335872,"data_compressed_original":1118208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,5,6,7,8,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280532,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44760,"kb_used_data":13568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327080,"statfs":{"total":96636764160,"available":96590929920,"internally_reserved":0,"allocated":13893632,"data_stored":17357236,"data_compressed":149759,"data_compressed_allocated":303104,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313237,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44364,"kb_used_data":13168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327476,"statfs":{"total":96636764160,"available":96591335424,"internally_reserved":0,"allocated":13484032,"data_stored":16876010,"data_compressed":151832,"data_compressed_allocated":307200,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313237,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34776,"kb_used_data":7744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337064,"statfs":{"total":96636764160,"available":96601153536,"internally_reserved":0,"allocated":7929856,"data_stored":11182570,"data_compressed":151832,"data_compressed_allocated":307200,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247830,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45264,"kb_used_data":14072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326576,"statfs":{"total":96636764160,"available":96590413824,"internally_reserved":0,"allocated":14409728,"data_stored":17615448,"data_compressed":153903,"data_compressed_allocated":311296,"data_compressed_original":622592,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,6,8,9,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215123,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37992,"kb_used_data":6800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333848,"statfs":{"total":96636764160,"available":96597860352,"internally_reserved":0,"allocated":6963200,"data_stored":7973073,"data_compressed":145609,"data_compressed_allocated":294912,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215126,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45984,"kb_used_data":14796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325856,"statfs":{"total":96636764160,"available":96589676544,"internally_reserved":0,"allocated":15151104,"data_stored":18956670,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215125,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44800,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327040,"statfs":{"total":96636764160,"available":96590888960,"internally_reserved":0,"allocated":13930496,"data_stored":18217150,"data_compressed":145609,"data_compressed_allocated":294912,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215125,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45620,"kb_used_data":10272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326220,"statfs":{"total":96636764160,"available":96590049280,"internally_reserved":0,"allocated":10518528,"data_stored":12382609,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182422,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40552,"kb_used_data":9360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331288,"statfs":{"total":96636764160,"available":96595238912,"internally_reserved":0,"allocated":9584640,"data_stored":12057012,"data_compressed":149759,"data_compressed_allocated":303104,"data_compressed_original":606208,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182420,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43056,"kb_used_data":11868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328784,"statfs":{"total":96636764160,"available":96592674816,"internally_reserved":0,"allocated":12152832,"data_stored":15483262,"data_compressed":147684,"data_compressed_allocated":299008,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15712256,"data_stored":20299776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6914048,"data_stored":8359936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7954432,"data_stored":11161600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8454144,"data_stored":11223040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13844480,"data_stored":18452480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13254656,"data_stored":17182720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":18132992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11034624,"data_stored":14659584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12341248,"data_stored":16031744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":6787072,"data_stored":10338304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":12824576,"data_stored":17403904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":15405056,"data_stored":20942848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":9396224,"data_stored":11558912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":2809856,"data_stored":4874240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":8257536,"data_stored":11812864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":6782976,"data_stored":9232384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:43:16.174 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T16:43:16.175 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:43:16.175 INFO:tasks.thrashosds.thrasher:Adding osd 13 2024-09-17T16:43:16.175 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 13 2024-09-17T16:43:16.183 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:16.183 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:16.201 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:16.201 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:16.205 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:16.202+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:16.208 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.208 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.217 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:43:16.217 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:16.218 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:16.234 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:16.234 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:16.251 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:16.252 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:16.269 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:16.269 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:16.286 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:16.287 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:16.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:16.305 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:16.306 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:16.304+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:16.320 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:16.318+0000 7fcb41a07640 0 -- 172.21.15.60:0/3816492153 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7fcb3c2241e0 msgr2=0x7fcb3c2265d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:16.321 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.321 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.333 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:43:16.407 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:16.405+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:16.437 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.437 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.445 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:43:16.453 INFO:tasks.rados.rados.0.smithi183.stdout:355: done (1 left) 2024-09-17T16:43:16.453 INFO:tasks.rados.rados.0.smithi183.stdout:356: rmattr oid 21 current snap is 35 2024-09-17T16:43:16.453 INFO:tasks.rados.rados.0.smithi183.stdout:357: snap_remove snap 32 2024-09-17T16:43:16.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:43:16.506 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-17T16:43:16.503+0000 7f599a036640 -1 mon.a@0(leader).osd e103 definitely_dead 0 2024-09-17T16:43:16.508 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:16.505+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:16.540 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:16.591 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.591 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.599 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:43:16.609 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:16.607+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:16.703 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.704 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.710 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:16.708+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:16.712 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:43:16.811 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:16.809+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:16.814 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.814 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.822 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:43:16.911 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:16.909+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:16.925 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:16.925 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:16.933 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:43:17.013 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:17.011+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:17.048 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.048 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.057 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:43:17.114 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:17.112+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:17.159 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.159 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.167 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:43:17.215 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:17.212+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:17.270 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.270 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.279 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:43:17.320 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:17.318+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:17.416 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:17.414+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:17.421 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.421 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.430 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:43:17.451 INFO:teuthology.orchestra.run.smithi060.stderr:marked in osd.13. 2024-09-17T16:43:17.451 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:43:17.457 INFO:tasks.rados.rados.0.smithi183.stdout:357: done (2 left) 2024-09-17T16:43:17.458 INFO:tasks.rados.rados.0.smithi183.stdout:358: delete oid 26 current snap is 35 2024-09-17T16:43:17.458 INFO:tasks.rados.rados.0.smithi183.stdout:352: finishing rollback tid 1 to smithi18337221-33 2024-09-17T16:43:17.458 INFO:tasks.rados.rados.0.smithi183.stdout:352: finishing rollback tid 2 to smithi18337221-33 2024-09-17T16:43:17.458 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 33 v 201 (ObjNum 68 snap 10 seq_num 68) dirty exists 2024-09-17T16:43:17.458 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 21 v 89 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-09-17T16:43:17.474 INFO:tasks.thrashosds.thrasher:Added osd 13 2024-09-17T16:43:17.517 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:17.515+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:17.536 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.537 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.545 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:43:17.618 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:17.616+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:17.687 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.687 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.696 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:43:17.718 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:17.717+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:17.798 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.798 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.807 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:43:17.851 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:17.849+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:17.911 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:17.911 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:17.920 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:43:17.921 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:17.918+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:18.021 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:18.019+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:18.066 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:18.066 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:18.074 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:43:18.122 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:18.120+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:18.177 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:18.177 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:18.186 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:43:18.222 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:18.220+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:18.323 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:18.320+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:18.329 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:18.329 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:18.338 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:43:18.424 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:18.423+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:18.442 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:18.442 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:18.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:43:18.525 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:18.522+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:18.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:43:18.588 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:18.589 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:18.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:43:18.626 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:18.623+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:18.689 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:18.689 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:18.707 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:18.725 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:18.725 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:18.727 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:18.725+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:18.742 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:18.742 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:18.753 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:18.753 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:18.753 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:18.753 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:18.753 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:18.758 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:18.758 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:18.762 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:43:18.775 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:18.776 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:18.792 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:18.792 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:18.810 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:18.810 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:18.826 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:18.828 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:18.826+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:18.843 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:18.844 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:18.862 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:18.878 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:18.878 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:18.885 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:209 3.6s0 3:6d4c68b4:::smithi18337221-35:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.391394614000006, 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019587552000000001, 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 209 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490471+0000", 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.492e-06 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490480+0000", 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:43:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490502+0000", 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2005e-05 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490512+0000", 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0129000000000001e-05 2024-09-17T16:43:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490586+0000", 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4232000000000003e-05 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490679+0000", 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2909000000000001e-05 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497687+0000", 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070084520000000001 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506016+0000", 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0083282830000000006 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509967+0000", 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039514509999999999 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510056+0000", 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8918000000000005e-05 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.391228838999993, 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018101223999999999, 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490635+0000", 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492045+0000", 2024-09-17T16:43:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001410644 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492086+0000", 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0726999999999998e-05 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492098+0000", 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2163e-05 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492226+0000", 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012778900000000001 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492241+0000", 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4932e-05 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508691+0000", 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016449693000000001 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508735+0000", 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4768999999999998e-05 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:372 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~507904] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.369169010999997, 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017260719000000001, 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 372 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512696+0000", 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8700000000000001e-06 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513289+0000", 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059281000000000004 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513305+0000", 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6494000000000002e-05 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513312+0000", 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5889999999999999e-06 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513379+0000", 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6659e-05 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513491+0000", 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011233199999999999 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514868+0000", 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001377407 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.525432+0000", 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010563863 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529881+0000", 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044490329999999998 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529955+0000", 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3662e-05 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:376 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.363411558999999, 2024-09-17T16:43:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015816857, 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 376 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.06e-07 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518456+0000", 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6679999999999999e-06 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518474+0000", 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8652e-05 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518481+0000", 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2920000000000001e-06 2024-09-17T16:43:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529124+0000", 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010643556 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529173+0000", 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8321e-05 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533229+0000", 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040568990000000001 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533274+0000", 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5016999999999999e-05 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.534268+0000", 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00099394599999999989 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:398 3.6s0 3:6f1c8401:::smithi18337221-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 50.271590396000001, 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015904456000000001, 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 398 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4400000000000001e-07 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610275+0000", 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0490000000000002e-06 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610279+0000", 2024-09-17T16:43:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7570000000000002e-06 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610282+0000", 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4139999999999998e-06 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621112+0000", 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010829319 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621164+0000", 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2238999999999999e-05 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625667+0000", 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0045036399999999997 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625718+0000", 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0970000000000002e-05 2024-09-17T16:43:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.626177+0000", 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045872399999999998 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:602 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~557056] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.409935315999999, 2024-09-17T16:43:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020848021000000001, 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 602 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471930+0000", 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4210000000000002e-06 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472516+0000", 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058545400000000001 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472540+0000", 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4527000000000001e-05 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472550+0000", 2024-09-17T16:43:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5920000000000007e-06 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472637+0000", 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7214999999999998e-05 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472648+0000", 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.474838+0000", 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0021897409999999998 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.474925+0000", 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6918999999999999e-05 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476046+0000", 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011207319999999999 2024-09-17T16:43:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492584+0000", 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016537854000000001 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492709+0000", 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012510599999999999 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492776+0000", 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7058999999999996e-05 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:603 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~638976] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.406573938000001, 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017813141000000001, 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 603 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475290+0000", 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.209e-06 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476082+0000", 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079194400000000005 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476100+0000", 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7829000000000002e-05 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476107+0000", 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8059999999999997e-06 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480053+0000", 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039456170000000002 2024-09-17T16:43:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480139+0000", 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6389000000000002e-05 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480834+0000", 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00069457000000000004 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492585+0000", 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01175114 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493048+0000", 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00046288200000000002 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493102+0000", 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4755e-05 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:605 3.6s0 3:6d4c68b4:::smithi18337221-35:head [setxattr _header (57) in=7b] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.480069+0000", 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.401794043999999, 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015621507, 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 605 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480069+0000", 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480069+0000", 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480070+0000", 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8599999999999998e-07 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480072+0000", 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3410000000000001e-06 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480077+0000", 2024-09-17T16:43:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6809999999999997e-06 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480080+0000", 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3400000000000002e-06 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493165+0000", 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013085266999999999 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493288+0000", 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012213400000000001 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493846+0000", 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00055891600000000001 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494593+0000", 2024-09-17T16:43:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00074671099999999995 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.495637+0000", 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001043792 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.495691+0000", 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3638999999999999e-05 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:606 3.6s0 3:6d4c68b4:::smithi18337221-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 29.401777500000001, 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017083732000000001, 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 606 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8999999999999998e-07 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480087+0000", 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4339999999999999e-06 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480091+0000", 2024-09-17T16:43:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9360000000000001e-06 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480094+0000", 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9900000000000002e-06 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494631+0000", 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014536445 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494697+0000", 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5832000000000003e-05 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.496058+0000", 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001361623 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.496104+0000", 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5401999999999997e-05 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.497169+0000", 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010657799999999999 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:631 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~3850240,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.435624906000001, 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016155756, 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 631 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446239+0000", 2024-09-17T16:43:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6700000000000003e-07 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446242+0000", 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5200000000000002e-06 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446247+0000", 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.164e-06 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446251+0000", 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6660000000000001e-06 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446397+0000", 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014552 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446403+0000", 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5440000000000004e-06 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.449745+0000", 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033422790000000001 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.449869+0000", 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012339100000000001 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462394+0000", 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012525105 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:632 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~3850240,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.435585516, 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020060099000000001, 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 632 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1e-07 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446281+0000", 2024-09-17T16:43:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.309e-06 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446292+0000", 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0852999999999999e-05 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446301+0000", 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6000000000000007e-06 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446432+0000", 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013141800000000001 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446442+0000", 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8099999999999992e-06 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.451647+0000", 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052050009999999999 2024-09-17T16:43:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.451706+0000", 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9515999999999997e-05 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466338+0000", 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014631282000000001 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.419322091000002, 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017904584000000001, 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462542+0000", 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7400000000000003e-07 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462693+0000", 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015141899999999999 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462706+0000", 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2813000000000001e-05 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462714+0000", 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2609999999999993e-06 2024-09-17T16:43:18.953 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462976+0000", 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026219399999999999 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462986+0000", 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5259999999999999e-06 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.954 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480397+0000", 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017411357999999998 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480446+0000", 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8439000000000002e-05 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:18.955 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.419124927999999, 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017745053, 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462739+0000", 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2900000000000004e-07 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.957 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462963+0000", 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00022424899999999999 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462976+0000", 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2843999999999999e-05 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462984+0000", 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2320000000000001e-06 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.958 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.469986+0000", 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070019690000000002 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.469993+0000", 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4309999999999997e-06 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480453+0000", 2024-09-17T16:43:18.959 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010459163 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480483+0000", 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0636000000000003e-05 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 85/34 ECSubWrite(tid=305, reqid=client.4553.0:683, at_version=85'114, trim_to=0'0, roll_forward_to=85'113))", 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.357752251000001, 2024-09-17T16:43:18.960 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018433593000000002, 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:18.961 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4899999999999995e-07 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524216+0000", 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010487100000000001 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.962 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524228+0000", 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.169e-05 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524235+0000", 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0790000000000003e-06 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524306+0000", 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0479000000000001e-05 2024-09-17T16:43:18.963 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524317+0000", 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1772e-05 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.542459+0000", 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018142121000000001 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.964 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.542544+0000", 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5031999999999995e-05 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 92/34 ECSubWrite(tid=61, reqid=osd.11.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=92'46))", 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.430617445999999, 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021134724000000001, 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.965 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.966 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5600000000000005e-07 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451258+0000", 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219999999999999e-05 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451270+0000", 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2377e-05 2024-09-17T16:43:18.967 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451280+0000", 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8039999999999996e-06 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.452018+0000", 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00073787500000000003 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.968 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.452028+0000", 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0539e-05 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.472336+0000", 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020308263999999999 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.472380+0000", 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3888999999999999e-05 2024-09-17T16:43:18.969 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.7s3 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.470236+0000", 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.411626776, 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019215115000000001, 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.970 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470236+0000", 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470236+0000", 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.971 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470237+0000", 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.67e-07 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470613+0000", 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00037657899999999999 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470629+0000", 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6308e-05 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.972 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470640+0000", 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0753e-05 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470728+0000", 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7577000000000005e-05 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470740+0000", 2024-09-17T16:43:18.973 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2364000000000001e-05 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489424+0000", 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018683669 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489451+0000", 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7597999999999999e-05 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.974 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:781 3.6s0 3:636772f7:::smithi18337221-13:head [rollback 1a] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4280373760000007, 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021405731000000001, 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 781 2024-09-17T16:43:18.975 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.976 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5799999999999999e-07 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453834+0000", 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2230000000000001e-06 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453842+0000", 2024-09-17T16:43:18.977 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0450000000000001e-06 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453847+0000", 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5860000000000004e-06 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453984+0000", 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013731400000000001 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.978 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453992+0000", 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0559999999999999e-06 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.458168+0000", 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004176903 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.458262+0000", 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3350999999999994e-05 2024-09-17T16:43:18.979 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.458809+0000", 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054745900000000003 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.465523+0000", 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0067142749999999996 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.980 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475142+0000", 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096188179999999995 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475231+0000", 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9142999999999997e-05 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:782 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~0] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:18.981 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4280062539999996, 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021585318999999999, 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 782 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.982 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8100000000000003e-07 2024-09-17T16:43:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453860+0000", 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6759999999999999e-06 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453867+0000", 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6669999999999999e-06 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.984 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453874+0000", 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4529999999999996e-06 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454027+0000", 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015268899999999999 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454034+0000", 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1319999999999996e-06 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.985 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.986 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.459979+0000", 2024-09-17T16:43:18.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059451900000000004 2024-09-17T16:43:18.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.986 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.460085+0000", 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105989 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.460614+0000", 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052899700000000002 2024-09-17T16:43:18.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.465525+0000", 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049110719999999998 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475361+0000", 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0098354810000000001 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475442+0000", 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1491999999999998e-05 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:792 3.6s0 3:6f1c8401:::smithi18337221-16:head [rmxattr OliOVUW in=7b,rmxattr QSnNfhP`\\rbs^]tkaRf]mXj_]bm_arNTstOQjkpY in=40b,rmxattr SXYNfcNts[adfhlcih^SbYXacRgpdjjt_UedQoso in=40b,rmxattr Y`URWapPpbRbcVnVY`QSNsZaZVYgbfr]kcmrp_g\\ in=40b,rmxattr b\\PtoYR`hmWtnd_a[S\\\\lXhWq]eThtkqjphngsWR in=40b,rmxattr cbOj`RWijYOTWkn\\Sk\\N_a[otcWhlc_kPXhaQhtm in=40b,rmxattr gac_OaSTa[cilYpd\\TYRomd[_[t]lkbeSfUstbbO in=40b,rmxattr iYtRdsiUT^YaZcYqmPkOTbnaa_c^ in=28b,rmxattr mRZhPnOqZXai[tb[_iYpr_fWU`VpVZePspesWXth in=40b,rmxattr rX`YVl[kmaRi[QfikjQasTjWZSRiWrW`bkcandUf in=40b] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.457790+0000", 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.424073258, 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019071910000000001, 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.990 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 792 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457790+0000", 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457790+0000", 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457792+0000", 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0679999999999999e-06 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457800+0000", 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0819999999999999e-06 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457813+0000", 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.313e-05 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457822+0000", 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4360000000000002e-06 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461035+0000", 2024-09-17T16:43:18.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0032138929999999998 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461151+0000", 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011519300000000001 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.462027+0000", 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00087607199999999998 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.466346+0000", 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043196839999999999 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476741+0000", 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01039495 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476862+0000", 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000120402 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.995 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.7s3 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.4028815300000002, 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016005958000000001, 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0599999999999999e-07 2024-09-17T16:43:18.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479302+0000", 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031962199999999998 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479318+0000", 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5832e-05 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:18.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479327+0000", 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479421+0000", 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3516000000000004e-05 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479434+0000", 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3573e-05 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:18.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494947+0000", 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015512685 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494988+0000", 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0363e-05 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.000 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:19.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:43:19.003 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:19.003 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:19.003 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:18.909+0000 7ffbd37fe640 0 -- 172.21.15.60:0/4166735191 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7ffbd421f410 msgr2=0x7ffbd4221800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:19.004 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:18.999+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:19.103 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:19.101+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:19.129 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:19.130 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:19.146 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:19.146 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:19.151 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:19.152 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:19.152 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:19.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:43:19.205 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:19.202+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:19.305 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:19.302+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:19.308 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:19.308 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:19.308 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:19.316 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:43:19.406 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:19.403+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:19.425 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:183 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~524288] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.947081155999996, 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029281946999999999, 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.426 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 183 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.427 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475561+0000", 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.475564+0000", 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7440000000000001e-06 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476278+0000", 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00071355599999999996 2024-09-17T16:43:19.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476295+0000", 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6820000000000002e-05 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476303+0000", 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8389999999999996e-06 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.429 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476360+0000", 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6677e-05 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.476366+0000", 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6559999999999997e-06 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479536+0000", 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031700700000000001 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.479663+0000", 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012687000000000001 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481168+0000", 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015057409999999999 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504456+0000", 2024-09-17T16:43:19.431 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023288011000000001 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504736+0000", 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027975599999999998 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504842+0000", 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010620699999999999 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.432 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:184 3.bs0 3:d3ea9383:::smithi18337221-42:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.945148403000005, 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029434406999999999, 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.433 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 184 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477493+0000", 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477495+0000", 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477870+0000", 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000374965 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.435 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477887+0000", 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7526000000000001e-05 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477903+0000", 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6135000000000001e-05 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3986000000000001e-05 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9600000000000003e-06 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497298+0000", 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01933416 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497409+0000", 2024-09-17T16:43:19.437 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000111018 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.498204+0000", 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079440999999999995 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505864+0000", 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076601710000000003 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.438 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506847+0000", 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098282699999999992 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506928+0000", 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0939000000000006e-05 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.439 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:185 3.bs0 3:d3ea9383:::smithi18337221-42:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.944721412000007, 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030938005000000001, 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.440 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 185 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477920+0000", 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477921+0000", 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9600000000000008e-07 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477926+0000", 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9880000000000004e-06 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.442 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0322e-05 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477943+0000", 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5699999999999998e-06 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477996+0000", 2024-09-17T16:43:19.443 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2816999999999999e-05 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4060000000000004e-06 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504911+0000", 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.026909729 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.444 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.504979+0000", 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7879000000000005e-05 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.505518+0000", 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00053870700000000003 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507877+0000", 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0023593889999999999 2024-09-17T16:43:19.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508773+0000", 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00089576100000000002 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508858+0000", 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5440999999999997e-05 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:186 3.bs0 3:d3ea9383:::smithi18337221-42:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.944687947999995, 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.032878611000000002, 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 186 2024-09-17T16:43:19.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.448 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477954+0000", 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2799999999999996e-07 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477957+0000", 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0910000000000001e-06 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.449 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477964+0000", 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1289999999999998e-06 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477970+0000", 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3879999999999999e-06 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478053+0000", 2024-09-17T16:43:19.450 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2705000000000002e-05 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478064+0000", 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0957e-05 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506531+0000", 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028467038 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506609+0000", 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8838999999999995e-05 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509235+0000", 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002625521 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509338+0000", 2024-09-17T16:43:19.452 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000103229 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510832+0000", 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001494186 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:197 3.bs0 3:d1457ac3:::smithi18337221-47:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:43:19.453 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.944641641999993, 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038806977999999999, 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 197 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:43:19.454 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478000+0000", 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478001+0000", 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.61e-07 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.455 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478007+0000", 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8889999999999999e-06 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478015+0000", 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8590000000000005e-06 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478020+0000", 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.293e-06 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478101+0000", 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0961e-05 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478107+0000", 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.925e-06 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507577+0000", 2024-09-17T16:43:19.457 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029470005000000001 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.507673+0000", 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6769999999999997e-05 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.512863+0000", 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0051892880000000002 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.458 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516432+0000", 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035693080000000002 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516720+0000", 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00028745600000000001 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.516807+0000", 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7462999999999999e-05 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.459 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:198 3.bs0 3:d1457ac3:::smithi18337221-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 65.944581788999997, 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037899077000000003, 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.460 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 198 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478060+0000", 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478061+0000", 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5799999999999998e-07 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478065+0000", 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.622e-06 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.462 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219e-05 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478086+0000", 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4679999999999998e-06 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478148+0000", 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2314e-05 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478157+0000", 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7460000000000006e-06 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508611+0000", 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030454205000000002 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508659+0000", 2024-09-17T16:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7987e-05 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515729+0000", 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070697629999999997 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515845+0000", 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000115872 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.465 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.515959+0000", 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114023 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:722 3.7s0 3:edf9cac5:::smithi18337221-37:head [copy-from ver 20] snapc 1f=[1e,1c,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.447807+0000", 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.974834856999999, 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.050674622000000002, 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.466 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 722 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447807+0000", 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.467 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447807+0000", 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447809+0000", 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.782e-06 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447816+0000", 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2980000000000003e-06 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.468 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447832+0000", 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6249999999999999e-05 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447841+0000", 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1200000000000008e-06 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447906+0000", 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5164000000000002e-05 2024-09-17T16:43:19.469 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447915+0000", 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6829999999999997e-06 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451020+0000", 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031045370000000001 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.470 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451125+0000", 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010541500000000001 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.469682+0000", 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018557138000000001 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489936+0000", 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020253818999999999 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.498406+0000", 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084702939999999997 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.498481+0000", 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.472 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:723 3.7s0 3:edf9cac5:::smithi18337221-37:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.974780701, 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.040894345999999998, 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 723 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447861+0000", 2024-09-17T16:43:19.474 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5200000000000002e-07 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447864+0000", 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.937e-06 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447873+0000", 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0250000000000008e-06 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.475 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447879+0000", 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9190000000000004e-06 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447984+0000", 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104571 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.447991+0000", 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2860000000000002e-06 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451292+0000", 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033009900000000002 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451341+0000", 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8511999999999999e-05 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488623+0000", 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037282167999999997 2024-09-17T16:43:19.477 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488686+0000", 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2792000000000005e-05 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488755+0000", 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9694000000000001e-05 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:729 3.7s0 3:e31d051c:::smithi18337221-15:head [read 0~491520,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.461755+0000", 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.960886767, 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.036062661000000003, 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 729 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.479 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461755+0000", 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461755+0000", 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.480 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461757+0000", 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.61e-06 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461763+0000", 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8800000000000002e-06 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461780+0000", 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6541e-05 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461787+0000", 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8680000000000001e-06 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488789+0000", 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027002103999999999 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.488840+0000", 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.1520000000000001e-05 2024-09-17T16:43:19.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.497818+0000", 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0089771380000000008 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:730 3.7s0 3:e31d051c:::smithi18337221-15:head [read 0~491520,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.960836789, 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.036471573, 2024-09-17T16:43:19.483 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 730 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461805+0000", 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0200000000000002e-07 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.485 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461810+0000", 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.1389999999999997e-06 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461818+0000", 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8990000000000001e-06 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461823+0000", 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2809999999999999e-06 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489583+0000", 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.027759872000000001 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489637+0000", 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4713999999999998e-05 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.487 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.498276+0000", 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0086390660000000008 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:731 3.7s0 3:e31d051c:::smithi18337221-15:head [read 0~491520,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 13.960810636, 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.037401763999999997, 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.488 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 731 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461831+0000", 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2899999999999999e-07 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461839+0000", 2024-09-17T16:43:19.490 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5909999999999998e-06 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461846+0000", 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.81e-06 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461851+0000", 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7770000000000002e-06 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.491 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.490181+0000", 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028330854999999999 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.490242+0000", 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0127999999999998e-05 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.499233+0000", 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0089911739999999993 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:789 3.7s0 3:e31d051c:::smithi18337221-15:head [copy-from ver 192] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.453951+0000", 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9686904710000004, 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.051440568999999998, 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.493 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 789 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453951+0000", 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453951+0000", 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.494 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453953+0000", 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.835e-06 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453960+0000", 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1040000000000001e-06 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453985+0000", 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4471999999999999e-05 2024-09-17T16:43:19.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453995+0000", 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0108999999999999e-05 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454067+0000", 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1942999999999999e-05 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454075+0000", 2024-09-17T16:43:19.496 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0819999999999999e-06 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457032+0000", 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.002957683 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457141+0000", 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000108509 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.497 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479048+0000", 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021906938000000001 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.498480+0000", 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019432056999999999 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.505328+0000", 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0068483779999999996 2024-09-17T16:43:19.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.505392+0000", 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3459000000000003e-05 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:790 3.7s0 3:e31d051c:::smithi18337221-15:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.454015+0000", 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9686262299999999, 2024-09-17T16:43:19.499 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.044357436, 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 790 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454015+0000", 2024-09-17T16:43:19.500 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454015+0000", 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454016+0000", 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7800000000000001e-07 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.501 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454020+0000", 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5609999999999999e-06 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454029+0000", 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1940000000000004e-06 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454036+0000", 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9589999999999998e-06 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454136+0000", 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.9978999999999999e-05 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454144+0000", 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1289999999999996e-06 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457311+0000", 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0031675119999999999 2024-09-17T16:43:19.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457360+0000", 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8523000000000003e-05 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.498223+0000", 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.040862862999999999 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.504 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.498280+0000", 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7463999999999997e-05 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.498373+0000", 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2573999999999998e-05 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.505 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:793 3.1s0 3:8551e558:::smithi18337221-41:head [append 0~524288] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.461504+0000", 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9611380940000007, 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.038558596000000001, 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 793 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.506 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461504+0000", 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461504+0000", 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461506+0000", 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5100000000000001e-06 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.463051+0000", 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0015445089999999999 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.463068+0000", 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.783e-05 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.463096+0000", 2024-09-17T16:43:19.508 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7393e-05 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.463267+0000", 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00017155600000000001 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.463392+0000", 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012475100000000001 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.509 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.464470+0000", 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001077606 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476033+0000", 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011562967 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.499999+0000", 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.023966785000000001 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.510 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.500062+0000", 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2688999999999996e-05 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:794 3.1s0 3:8551e558:::smithi18337221-41:head [append 0~573440] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.466597+0000", 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9560446959999993, 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.036370751999999999, 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.511 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 794 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.466597+0000", 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.466597+0000", 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.466599+0000", 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.615e-06 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.467110+0000", 2024-09-17T16:43:19.513 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00051132 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.467123+0000", 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2924e-05 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.467129+0000", 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2160000000000003e-06 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.514 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.469144+0000", 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0020146740000000002 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.469258+0000", 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000114262 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.470229+0000", 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00097116100000000001 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.489155+0000", 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018926097999999999 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502881+0000", 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013726169999999999 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502968+0000", 2024-09-17T16:43:19.516 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6311999999999996e-05 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:795 3.1s0 3:8551e558:::smithi18337221-41:head [append 0~688128] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.472167+0000", 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9504744429999992, 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030950083, 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.517 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 795 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.472167+0000", 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.518 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.472167+0000", 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.472169+0000", 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6020000000000001e-06 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.473396+0000", 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0012272069999999999 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.519 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.473421+0000", 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5054000000000001e-05 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.473429+0000", 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.055e-06 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476293+0000", 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028640499999999999 2024-09-17T16:43:19.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476399+0000", 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010562599999999999 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.477404+0000", 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010047439999999999 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.489268+0000", 2024-09-17T16:43:19.521 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011863991000000001 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503057+0000", 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013789144999999999 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503117+0000", 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0609000000000002e-05 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.522 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:796 3.1s0 3:8551e558:::smithi18337221-41:head [append 0~294912] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.473442+0000", 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9491992109999998, 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029841178999999999, 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 796 2024-09-17T16:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.473442+0000", 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.473442+0000", 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.524 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.473444+0000", 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.085e-06 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474168+0000", 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00072493799999999995 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474179+0000", 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0509999999999999e-05 2024-09-17T16:43:19.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474184+0000", 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.87e-06 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.484845+0000", 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010661502999999999 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.526 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.484983+0000", 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013812300000000001 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.485924+0000", 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00094070700000000004 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.489367+0000", 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0034427910000000002 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.527 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503235+0000", 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013867920000000001 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503284+0000", 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8732e-05 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:798 3.1s0 3:8551e558:::smithi18337221-41:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.474207+0000", 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 9.9484348499999999, 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.030173439999999999, 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 798 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.529 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474207+0000", 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474207+0000", 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474207+0000", 2024-09-17T16:43:19.530 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.5100000000000001e-07 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474211+0000", 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5310000000000002e-06 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474216+0000", 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.31e-06 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.531 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.474221+0000", 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.9710000000000003e-06 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490599+0000", 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016378556999999998 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490707+0000", 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010713900000000001 2024-09-17T16:43:19.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503814+0000", 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013107213 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503865+0000", 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0914000000000001e-05 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.533 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.504380+0000", 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00051555399999999999 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:871 3.ds0 3:b01f2307:::smithi18337221-20:head [copy-from ver 88] snapc 24=[23,22,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:14.480705+0000", 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.9419361760000005, 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.069347761999999993, 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:19.534 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 871 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480705+0000", 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.535 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480705+0000", 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480706+0000", 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8299999999999997e-07 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480709+0000", 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.309e-06 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480717+0000", 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2509999999999997e-06 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480722+0000", 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3149999999999999e-06 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.481036+0000", 2024-09-17T16:43:19.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031421299999999998 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.481120+0000", 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4377999999999997e-05 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.512845+0000", 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.031724832000000001 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:19.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.547127+0000", 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.034281818999999998 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.549962+0000", 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0028352659999999999 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.550053+0000", 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0896000000000005e-05 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.539 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:872 3.ds0 3:b01f2307:::smithi18337221-20:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:14.480729+0000", 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 4.9419126640000002, 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.066307670999999999, 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.540 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 872 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480729+0000", 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480729+0000", 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480729+0000", 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8500000000000002e-07 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480733+0000", 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3610000000000001e-06 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480736+0000", 2024-09-17T16:43:19.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.664e-06 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.480739+0000", 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7300000000000001e-06 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.482605+0000", 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018657649999999999 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.482651+0000", 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6047000000000001e-05 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.546798+0000", 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.064146856000000002 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.546910+0000", 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011246 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.547037+0000", 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000126503 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.545 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:19.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:43:19.547 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:19.544+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:19.547 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:43:19.645 INFO:tasks.rados.rados.0.smithi183.stdout:352: done (2 left) 2024-09-17T16:43:19.645 INFO:tasks.rados.rados.0.smithi183.stdout:356: done (1 left) 2024-09-17T16:43:19.646 INFO:tasks.rados.rados.0.smithi183.stdout:358: done (0 left) 2024-09-17T16:43:19.646 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 11 current snap is 35 2024-09-17T16:43:19.646 INFO:tasks.rados.rados.0.smithi183.stdout:359: seq_num 135 ranges {3342336=720896,4063232=622592,4685824=688128,5373952=245760} 2024-09-17T16:43:19.647 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:19.645+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:19.667 INFO:tasks.rados.rados.0.smithi183.stdout:359: writing smithi18337221-11 from 3342336 to 4063232 tid 1 2024-09-17T16:43:19.670 INFO:tasks.rados.rados.0.smithi183.stdout:359: writing smithi18337221-11 from 4063232 to 4685824 tid 2 2024-09-17T16:43:19.673 INFO:tasks.rados.rados.0.smithi183.stdout:359: writing smithi18337221-11 from 4685824 to 5373952 tid 3 2024-09-17T16:43:19.675 INFO:tasks.rados.rados.0.smithi183.stdout:359: writing smithi18337221-11 from 5373952 to 5619712 tid 4 2024-09-17T16:43:19.675 INFO:tasks.rados.rados.0.smithi183.stdout:360: delete oid 32 current snap is 35 2024-09-17T16:43:19.680 INFO:tasks.rados.rados.0.smithi183.stdout:360: done (1 left) 2024-09-17T16:43:19.680 INFO:tasks.rados.rados.0.smithi183.stdout:361: read oid 25 snap -1 2024-09-17T16:43:19.680 INFO:tasks.rados.rados.0.smithi183.stdout:361: expect deleted 2024-09-17T16:43:19.680 INFO:tasks.rados.rados.0.smithi183.stdout:362: snap_remove snap 26 2024-09-17T16:43:19.709 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:19.710 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:19.710 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:19.710 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:19.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:43:19.760 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:19.758+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:19.849 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:19.847+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:19.868 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:19.868 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:19.868 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:19.868 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:19.868 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:19.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:43:19.950 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:19.948+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:19.985 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:19.985 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:19.985 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:19.985 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:200 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.504556065000003, 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011662507000000001, 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 200 2024-09-17T16:43:19.986 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477879+0000", 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.987 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477880+0000", 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.8599999999999998e-07 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477886+0000", 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5740000000000001e-06 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.988 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477906+0000", 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9604000000000001e-05 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477914+0000", 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5859999999999999e-06 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478028+0000", 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011431500000000001 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.989 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478034+0000", 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0530000000000003e-06 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481597+0000", 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0035624699999999999 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.481685+0000", 2024-09-17T16:43:19.990 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8129999999999998e-05 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.489542+0000", 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078571890000000005 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:201 3.4s0 3:2affd2d4:::smithi18337221-25:head [read 0~1261568,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:19.991 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 66.504506399999997, 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013839093, 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 201 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.992 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477929+0000", 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477930+0000", 2024-09-17T16:43:19.993 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477937+0000", 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1189999999999999e-06 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477949+0000", 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1701e-05 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.994 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.477955+0000", 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6529999999999997e-06 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478077+0000", 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000121858 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.478083+0000", 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7150000000000003e-06 2024-09-17T16:43:19.995 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482035+0000", 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039517290000000002 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482114+0000", 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.9499000000000006e-05 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.996 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.491768+0000", 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096540259999999996 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es4 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:43:19.997 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 51.486055092999997, 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013323026999999999, 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496380+0000", 2024-09-17T16:43:19.998 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496381+0000", 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496856+0000", 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00047436000000000001 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:19.999 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496867+0000", 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.165e-05 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496876+0000", 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8650000000000007e-06 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496951+0000", 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4673999999999997e-05 2024-09-17T16:43:20.000 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.496961+0000", 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.048e-05 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012637884 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.001 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509703+0000", 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000104149 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.456871+0000", 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.525564342999999, 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.022293289000000001, 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.002 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456871+0000", 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456871+0000", 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.003 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456872+0000", 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5000000000000002e-07 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458675+0000", 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0018029400000000001 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458693+0000", 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7893e-05 2024-09-17T16:43:20.004 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458705+0000", 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.271e-05 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458806+0000", 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010067 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458819+0000", 2024-09-17T16:43:20.005 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2772000000000001e-05 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479072+0000", 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020253589999999998 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479164+0000", 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2064000000000005e-05 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.006 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.461608+0000", 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.520826881000001, 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017586277000000001, 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.007 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.461608+0000", 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.461608+0000", 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.461610+0000", 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5859999999999999e-06 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.008 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462598+0000", 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0009879890000000001 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462621+0000", 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3173999999999999e-05 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462633+0000", 2024-09-17T16:43:20.009 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1326e-05 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.468213+0000", 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055799550000000002 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.468229+0000", 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6562000000000002e-05 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.010 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479174+0000", 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010945175 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.479195+0000", 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0509999999999998e-05 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.011 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs1 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.467746+0000", 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.51468938, 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012456467000000001, 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467746+0000", 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.012 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467746+0000", 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467747+0000", 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1969999999999999e-06 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467983+0000", 2024-09-17T16:43:20.013 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023602200000000001 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.467999+0000", 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6121999999999999e-05 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.468011+0000", 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1399999999999999e-05 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.014 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472902+0000", 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0048909080000000002 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.472912+0000", 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0091e-05 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480018+0000", 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0071064079999999998 2024-09-17T16:43:20.015 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480202+0000", 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00018431900000000001 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.016 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:669 3.as0 3:50831259:::smithi18337221-29:head [append 0~688128] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.677948+0000", 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.304487053999999, 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01517751, 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 669 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.017 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.677948+0000", 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.677948+0000", 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.677949+0000", 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1310000000000001e-06 2024-09-17T16:43:20.018 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678731+0000", 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00078166399999999995 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678743+0000", 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1916000000000001e-05 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.019 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678748+0000", 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4539999999999998e-06 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678804+0000", 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5757999999999997e-05 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.678873+0000", 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9177000000000005e-05 2024-09-17T16:43:20.020 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.679683+0000", 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00080923099999999999 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.687830+0000", 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0081469899999999998 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.021 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693051+0000", 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052210939999999999 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693126+0000", 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5094999999999998e-05 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:670 3.as0 3:50831259:::smithi18337221-29:head [append 0~507904] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:20.022 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.680616+0000", 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.301819496, 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013565578999999999, 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 670 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.023 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.680616+0000", 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.680616+0000", 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.024 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.680617+0000", 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6130000000000001e-06 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.681206+0000", 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058880499999999997 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.681223+0000", 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6773e-05 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.025 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.681232+0000", 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6710000000000005e-06 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684019+0000", 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00278678 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684102+0000", 2024-09-17T16:43:20.026 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3871999999999999e-05 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684877+0000", 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00077472000000000001 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693144+0000", 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0082665640000000006 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.027 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.694145+0000", 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010013909999999999 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.694181+0000", 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6390000000000002e-05 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.028 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:672 3.as0 3:50831259:::smithi18337221-29:head [setxattr _header (57) in=7b] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.297488615999999, 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012184228, 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 672 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.029 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.030 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.031 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684947+0000", 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0900000000000001e-07 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684949+0000", 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1220000000000002e-06 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684955+0000", 2024-09-17T16:43:20.032 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2739999999999998e-06 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684958+0000", 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0630000000000002e-06 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.033 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.692428+0000", 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0074701359999999996 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.692487+0000", 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9407999999999998e-05 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.692763+0000", 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000275412 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.034 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693220+0000", 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045707300000000001 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697075+0000", 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0038546700000000001 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697131+0000", 2024-09-17T16:43:20.035 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6461e-05 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:673 3.as0 3:50831259:::smithi18337221-29:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:43:20.036 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 24.297473182000001, 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013116195000000001, 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 673 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.037 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.038 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684962+0000", 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.53e-07 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684964+0000", 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.361e-06 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.039 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684967+0000", 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6669999999999998e-06 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.684970+0000", 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6809999999999998e-06 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.040 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693421+0000", 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0084511389999999999 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.693467+0000", 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6022000000000001e-05 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697450+0000", 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039822379999999999 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.041 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.697515+0000", 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5032999999999999e-05 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.698078+0000", 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00056380099999999995 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.042 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 92/34 ECSubWrite(tid=304, reqid=client.4553.0:724, at_version=92'66, trim_to=0'0, roll_forward_to=85'64))", 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.460638+0000", 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.521797831000001, 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017787198000000001, 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.460638+0000", 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.043 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.460638+0000", 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.460638+0000", 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.34e-07 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461247+0000", 2024-09-17T16:43:20.044 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00060919800000000003 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461263+0000", 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6140000000000001e-05 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461273+0000", 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4269999999999997e-06 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.045 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461373+0000", 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010073099999999999 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461382+0000", 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0710000000000001e-06 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.478386+0000", 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017003178000000001 2024-09-17T16:43:20.046 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.478425+0000", 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9218999999999998e-05 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s1 92/34 ECSubWrite(tid=305, reqid=client.4553.0:725, at_version=92'67, trim_to=0'0, roll_forward_to=85'64))", 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.467187+0000", 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 14.515247968000001, 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011336964, 2024-09-17T16:43:20.047 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467187+0000", 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467187+0000", 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.048 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467188+0000", 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8199999999999999e-07 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467590+0000", 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00040196600000000002 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.049 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467604+0000", 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3585e-05 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467612+0000", 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0590000000000003e-06 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.468635+0000", 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010234160000000001 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.050 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.468648+0000", 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2607e-05 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.478503+0000", 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0098548779999999992 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.051 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.478524+0000", 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1770999999999999e-05 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:799 3.4s0 3:216603c8:::smithi18337221-7:head [append 0~540672] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.477805+0000", 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.504630458999999, 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.024283625, 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.052 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 799 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.477805+0000", 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.053 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.477805+0000", 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.477808+0000", 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1039999999999998e-06 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478835+0000", 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010273999999999999 2024-09-17T16:43:20.054 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478857+0000", 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1458e-05 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478867+0000", 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0451999999999999e-05 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.055 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478944+0000", 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6954999999999998e-05 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479068+0000", 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012411099999999999 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.480196+0000", 2024-09-17T16:43:20.056 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001127769 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494350+0000", 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014153715000000001 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502005+0000", 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0076547439999999998 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.057 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502089+0000", 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3917000000000003e-05 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:800 3.4s0 3:216603c8:::smithi18337221-7:head [append 0~720896] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.482935+0000", 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.499500653, 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.025442642000000001, 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.058 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 800 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.482935+0000", 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.059 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.482935+0000", 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.482936+0000", 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7060000000000001e-06 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.483616+0000", 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00067948800000000001 2024-09-17T16:43:20.060 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.483627+0000", 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1507e-05 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.483636+0000", 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6570000000000003e-06 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.486274+0000", 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0026382580000000001 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.486387+0000", 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000112409 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.487368+0000", 2024-09-17T16:43:20.062 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00098142699999999999 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.501776+0000", 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014408018999999999 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508334+0000", 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065582460000000002 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.063 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508377+0000", 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.2925e-05 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:801 3.4s0 3:216603c8:::smithi18337221-7:head [append 0~786432] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.489249+0000", 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.49318635, 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019271666, 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.064 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 801 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.489249+0000", 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.065 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.489249+0000", 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.489251+0000", 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.759e-06 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.066 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490080+0000", 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00082920400000000005 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490096+0000", 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6235e-05 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490105+0000", 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8040000000000007e-06 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.067 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494401+0000", 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0042958409999999999 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494499+0000", 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8177000000000005e-05 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.068 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.495422+0000", 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000922656 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.501899+0000", 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0064773039999999997 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508473+0000", 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065741230000000003 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.069 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508521+0000", 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.7562999999999998e-05 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.070 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:802 3.4s0 3:216603c8:::smithi18337221-7:head [append 0~49152] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.490122+0000", 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.492313387999999, 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018500699999999998, 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.071 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 802 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490122+0000", 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490122+0000", 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490123+0000", 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.6799999999999999e-07 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490150+0000", 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7651999999999999e-05 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490163+0000", 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2666999999999999e-05 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490169+0000", 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.0430000000000004e-06 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.500378+0000", 2024-09-17T16:43:20.074 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010208445 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.500480+0000", 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010241199999999999 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.501123+0000", 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00064308599999999996 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.075 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502246+0000", 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001122734 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508585+0000", 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0063394180000000003 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508623+0000", 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7475000000000003e-05 2024-09-17T16:43:20.076 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:803 3.4s0 3:216603c8:::smithi18337221-7:head [setxattr _header (56) in=7b] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.490178+0000", 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.492257794, 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018552986, 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.077 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 803 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490178+0000", 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490178+0000", 2024-09-17T16:43:20.078 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490178+0000", 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.37e-07 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490181+0000", 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8399999999999999e-06 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.079 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490187+0000", 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1040000000000003e-06 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490192+0000", 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8740000000000003e-06 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502435+0000", 2024-09-17T16:43:20.080 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012242803 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502516+0000", 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0865000000000006e-05 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.502803+0000", 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000287497 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.081 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503317+0000", 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00051388200000000001 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508682+0000", 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053646359999999999 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.082 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.508731+0000", 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8948e-05 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:804 3.4s0 3:216603c8:::smithi18337221-7:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.490198+0000", 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.492237469999999, 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019320459000000002, 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.083 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 804 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490198+0000", 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.084 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490198+0000", 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490198+0000", 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3099999999999998e-07 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490200+0000", 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9850000000000001e-06 2024-09-17T16:43:20.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490206+0000", 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7540000000000003e-06 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.490211+0000", 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5970000000000002e-06 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503008+0000", 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012797731 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.503095+0000", 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6629e-05 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.509023+0000", 2024-09-17T16:43:20.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059275999999999999 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.509069+0000", 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6181999999999999e-05 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.509518+0000", 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00044955 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.0s4 101/77 ECSubWrite(tid=149, reqid=client.4553.0:876, at_version=101'60, trim_to=0'0, roll_forward_to=100'58))", 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:14.508762+0000", 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 5.4736730339999999, 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012095470000000001, 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.508762+0000", 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.508762+0000", 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.508764+0000", 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5549999999999999e-06 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.509226+0000", 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00046247200000000001 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.509248+0000", 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1834000000000001e-05 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.509259+0000", 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0305999999999999e-05 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.509333+0000", 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4299000000000001e-05 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.509348+0000", 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5214e-05 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.520815+0000", 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01146672 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.520858+0000", 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3069999999999999e-05 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.ds5 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:14.512993+0000", 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 5.4694420460000002, 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.029703798999999999, 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.512993+0000", 2024-09-17T16:43:20.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.512993+0000", 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.512995+0000", 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.153e-06 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.095 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.513851+0000", 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00085503700000000001 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.513873+0000", 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2870999999999998e-05 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.513905+0000", 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1294999999999998e-05 2024-09-17T16:43:20.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.514013+0000", 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010832600000000001 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.514023+0000", 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0343000000000001e-05 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.542663+0000", 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.028639694 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.542697+0000", 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4079999999999999e-05 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.098 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:20.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:43:20.100 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:20.098+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:20.201 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:20.199+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:20.249 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:20.250 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:20.250 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:20.250 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:20.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:43:20.301 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:20.299+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:20.402 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:20.399+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:20.406 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:20.406 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:20.406 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:20.406 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:20.406 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:20.414 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:43:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:43:20.456 INFO:tasks.rados.rados.0.smithi183.stdout:359: finishing write tid 1 to smithi18337221-11 2024-09-17T16:43:20.456 INFO:tasks.rados.rados.0.smithi183.stdout:359: finishing write tid 2 to smithi18337221-11 2024-09-17T16:43:20.456 INFO:tasks.rados.rados.0.smithi183.stdout:359: finishing write tid 3 to smithi18337221-11 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: finishing write tid 4 to smithi18337221-11 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: finishing write tid 5 to smithi18337221-11 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: finishing write tid 6 to smithi18337221-11 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: oid 11 updating version 0 to 219 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: oid 11 version 219 is already newer than 217 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: oid 11 updating version 219 to 220 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: oid 11 version 220 is already newer than 218 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: oid 11 updating version 220 to 221 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 221 (ObjNum 135 snap 35 seq_num 135) dirty exists 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: left oid 11 (ObjNum 135 snap 35 seq_num 135) 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:359: done (2 left) 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:361: done (1 left) 2024-09-17T16:43:20.457 INFO:tasks.rados.rados.0.smithi183.stdout:362: done (0 left) 2024-09-17T16:43:20.458 INFO:tasks.rados.rados.0.smithi183.stdout:363: copy_from oid 3 from oid 28 current snap is 35 2024-09-17T16:43:20.458 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 45 current snap is 35 2024-09-17T16:43:20.458 INFO:tasks.rados.rados.0.smithi183.stdout:364: seq_num 137 ranges {0=753664,753664=786432,1540096=655360,2195456=114688} 2024-09-17T16:43:20.461 INFO:tasks.rados.rados.0.smithi183.stdout:364: writing smithi18337221-45 from 0 to 753664 tid 1 2024-09-17T16:43:20.466 INFO:tasks.rados.rados.0.smithi183.stdout:364: writing smithi18337221-45 from 753664 to 1540096 tid 2 2024-09-17T16:43:20.470 INFO:tasks.rados.rados.0.smithi183.stdout:364: writing smithi18337221-45 from 1540096 to 2195456 tid 3 2024-09-17T16:43:20.471 INFO:tasks.rados.rados.0.smithi183.stdout:364: writing smithi18337221-45 from 2195456 to 2310144 tid 4 2024-09-17T16:43:20.471 INFO:tasks.rados.rados.0.smithi183.stdout:365: setattr oid 11 current snap is 35 2024-09-17T16:43:20.473 INFO:tasks.rados.rados.0.smithi183.stdout:366: snap_create 2024-09-17T16:43:20.503 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:20.500+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:20.535 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 67.050154625000005, 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011223067999999999, 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.536 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482334+0000", 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482335+0000", 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5499999999999999e-07 2024-09-17T16:43:20.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482482+0000", 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014705100000000001 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482496+0000", 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4164e-05 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.538 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482513+0000", 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6529e-05 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482631+0000", 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011836999999999999 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.539 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.482642+0000", 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0895e-05 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493489+0000", 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010846876 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.493558+0000", 2024-09-17T16:43:20.540 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8827999999999999e-05 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 50/34 ECSubWrite(tid=111, reqid=client.4553.0:287, at_version=50'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:43:20.541 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.070928029999997, 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010954281999999999, 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.542 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461561+0000", 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.461562+0000", 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3300000000000002e-07 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462055+0000", 2024-09-17T16:43:20.543 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00049369500000000005 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462066+0000", 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1012000000000001e-05 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462074+0000", 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1790000000000008e-06 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.544 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462143+0000", 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8353000000000001e-05 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.462154+0000", 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0773e-05 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472429+0000", 2024-09-17T16:43:20.545 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010275876999999999 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:23.472515+0000", 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5859999999999994e-05 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:43:20.546 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.035222990000001, 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012371190000000001, 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497266+0000", 2024-09-17T16:43:20.547 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497267+0000", 2024-09-17T16:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.3900000000000004e-07 2024-09-17T16:43:20.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497341+0000", 2024-09-17T16:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4518999999999996e-05 2024-09-17T16:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497362+0000", 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.1165000000000001e-05 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497371+0000", 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.85e-06 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497442+0000", 2024-09-17T16:43:20.550 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0967e-05 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.497451+0000", 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6989999999999992e-06 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509599+0000", 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012148320000000001 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.551 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.509637+0000", 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8031000000000002e-05 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 52.033427627000002, 2024-09-17T16:43:20.552 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015236921, 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499061+0000", 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499063+0000", 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1850000000000001e-06 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499453+0000", 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00039015399999999998 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499469+0000", 2024-09-17T16:43:20.554 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6203000000000001e-05 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499478+0000", 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6039999999999993e-06 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499561+0000", 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3509000000000003e-05 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.555 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.499570+0000", 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.1050000000000001e-06 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514274+0000", 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014703344 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514298+0000", 2024-09-17T16:43:20.556 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4817e-05 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 56/34 ECSubWrite(tid=105, reqid=client.4553.0:400, at_version=56'10, trim_to=0'0, roll_forward_to=37'8))", 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 51.039902333000001, 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013544347999999999, 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.492587+0000", 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.3200000000000001e-07 2024-09-17T16:43:20.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493013+0000", 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00042638399999999998 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493028+0000", 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4295e-05 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.559 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493038+0000", 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0543999999999999e-05 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493139+0000", 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000100438 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.493149+0000", 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0241000000000001e-05 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.560 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506098+0000", 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012948665 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:29.506131+0000", 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3549e-05 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:20.561 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 45.072026633999997, 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010326251, 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.562 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460462+0000", 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460463+0000", 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1600000000000001e-07 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460617+0000", 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000153993 2024-09-17T16:43:20.563 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460630+0000", 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2549e-05 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460639+0000", 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0669999999999998e-06 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.564 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460779+0000", 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000140159 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.460843+0000", 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4352999999999999e-05 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470758+0000", 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0099145610000000006 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:35.470789+0000", 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0953e-05 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 35.074513586000002, 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.011234937, 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.566 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457975+0000", 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.457976+0000", 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4099999999999998e-07 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458102+0000", 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012563099999999999 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.568 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458116+0000", 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3919e-05 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458124+0000", 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.8040000000000002e-06 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458188+0000", 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4793000000000001e-05 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.458197+0000", 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9649999999999997e-06 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.469156+0000", 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010959106999999999 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.469210+0000", 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.3977000000000002e-05 2024-09-17T16:43:20.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 72/34 ECSubWrite(tid=207, reqid=client.4553.0:549, at_version=72'37, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 35.069405805000002, 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0095375779999999997, 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463083+0000", 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.572 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463084+0000", 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5099999999999999e-07 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463284+0000", 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00019973899999999999 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463300+0000", 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5948999999999999e-05 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.573 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463309+0000", 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.6169999999999996e-06 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463477+0000", 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016754000000000001 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.463487+0000", 2024-09-17T16:43:20.574 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0301e-05 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.472531+0000", 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0090443920000000001 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:45.472621+0000", 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9388999999999994e-05 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.075515554999999, 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019139819999999998, 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.576 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.456974+0000", 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.8000000000000001e-07 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.577 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458736+0000", 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001762018 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458753+0000", 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7102999999999999e-05 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458764+0000", 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1039000000000001e-05 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458889+0000", 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012515399999999999 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.458909+0000", 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.9313e-05 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476059+0000", 2024-09-17T16:43:20.579 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017150744999999998 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476113+0000", 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4067999999999998e-05 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462240+0000", 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.070249219000001, 2024-09-17T16:43:20.580 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013909334000000001, 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462240+0000", 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462240+0000", 2024-09-17T16:43:20.581 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462241+0000", 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.339e-06 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462395+0000", 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015429300000000001 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.582 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462420+0000", 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4655999999999999e-05 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462438+0000", 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7635999999999999e-05 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.583 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466467+0000", 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040290999999999999 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466481+0000", 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3736e-05 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476122+0000", 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096414090000000001 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476149+0000", 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7165000000000002e-05 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs5 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.466622+0000", 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.065867406999999, 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0099262970000000006, 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.585 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466622+0000", 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466622+0000", 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466623+0000", 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.31e-06 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466833+0000", 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00020982299999999999 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.587 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466853+0000", 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0136000000000002e-05 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466863+0000", 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0369e-05 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.471546+0000", 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0046829259999999996 2024-09-17T16:43:20.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.471555+0000", 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8769999999999999e-06 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476508+0000", 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049527670000000003 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.589 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.476548+0000", 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0089000000000002e-05 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 82/77 ECSubWrite(tid=181, reqid=client.4553.0:642, at_version=82'81, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 25.059336728000002, 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010671649, 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.590 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.591 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473152+0000", 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4100000000000001e-07 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473602+0000", 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00044972499999999999 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473617+0000", 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5176e-05 2024-09-17T16:43:20.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473627+0000", 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4409999999999999e-06 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473713+0000", 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5990999999999997e-05 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.593 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.473725+0000", 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2631e-05 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.483778+0000", 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010052306 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.483824+0000", 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6238e-05 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.594 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 92/34 ECSubWrite(tid=304, reqid=client.4553.0:724, at_version=92'66, trim_to=0'0, roll_forward_to=85'64))", 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.460565+0000", 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.071923936999999, 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014643787, 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.595 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.460565+0000", 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.460565+0000", 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.460565+0000", 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5599999999999999e-07 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.596 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461177+0000", 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00061219200000000001 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461191+0000", 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3383e-05 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461200+0000", 2024-09-17T16:43:20.597 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6370000000000005e-06 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461264+0000", 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.4331999999999993e-05 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.461273+0000", 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9570000000000008e-06 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.598 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.475126+0000", 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.013852834 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.475209+0000", 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.3295999999999997e-05 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.5s4 92/34 ECSubWrite(tid=305, reqid=client.4553.0:725, at_version=92'67, trim_to=0'0, roll_forward_to=85'64))", 2024-09-17T16:43:20.599 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.467391+0000", 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 15.065097725999999, 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012492046, 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467391+0000", 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.600 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467391+0000", 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467392+0000", 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.37e-07 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467670+0000", 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027748200000000001 2024-09-17T16:43:20.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467684+0000", 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4625e-05 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.467693+0000", 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2809999999999997e-06 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.469115+0000", 2024-09-17T16:43:20.602 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00142151 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.469124+0000", 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5750000000000001e-06 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.479850+0000", 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01072613 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.479883+0000", 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.3705999999999999e-05 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.604 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 97/77 ECSubWrite(tid=215, reqid=client.4553.0:806, at_version=97'117, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:10.459100+0000", 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.073389056, 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0094712330000000008, 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.605 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459100+0000", 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459100+0000", 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459100+0000", 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7300000000000002e-07 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459482+0000", 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00038218300000000002 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459497+0000", 2024-09-17T16:43:20.607 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4459e-05 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459508+0000", 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0688e-05 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459585+0000", 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.7866000000000003e-05 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.608 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.459597+0000", 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1019000000000001e-05 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468496+0000", 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0088992729999999992 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468571+0000", 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5471999999999998e-05 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.609 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 97/77 ECSubWrite(tid=216, reqid=client.4553.0:807, at_version=97'118, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:10.464575+0000", 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.067914231, 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010448913000000001, 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.610 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.464575+0000", 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.464575+0000", 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.464576+0000", 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2800000000000005e-07 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.611 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.464742+0000", 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00016582899999999999 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.464755+0000", 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.347e-05 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.464765+0000", 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4509999999999998e-06 2024-09-17T16:43:20.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.465175+0000", 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00041045799999999999 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.465184+0000", 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0489999999999993e-06 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.613 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.474980+0000", 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0097961560000000003 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.475024+0000", 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3572000000000002e-05 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 97/77 ECSubWrite(tid=217, reqid=client.4553.0:808, at_version=97'119, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:10.468376+0000", 2024-09-17T16:43:20.614 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.064113206, 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014526061, 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468376+0000", 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.615 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468376+0000", 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468377+0000", 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7499999999999999e-07 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468594+0000", 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00021685300000000001 2024-09-17T16:43:20.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468606+0000", 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2092e-05 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468619+0000", 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3359e-05 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.617 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468689+0000", 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.9479000000000003e-05 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.468700+0000", 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1141999999999999e-05 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.482855+0000", 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014155489 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.618 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.482902+0000", 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.6771999999999999e-05 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.es6 97/77 ECSubWrite(tid=218, reqid=client.4553.0:809, at_version=97'120, trim_to=0'0, roll_forward_to=97'117))", 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:10.472730+0000", 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.059759032000001, 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010201493000000001, 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.619 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.472730+0000", 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.472730+0000", 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.620 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.472731+0000", 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.438e-06 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.473011+0000", 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00027967699999999999 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.473028+0000", 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7153999999999999e-05 2024-09-17T16:43:20.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.473038+0000", 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5170000000000005e-06 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.475062+0000", 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0020245269999999999 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.475073+0000", 2024-09-17T16:43:20.622 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0584999999999999e-05 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.482907+0000", 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0078338439999999995 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.482932+0000", 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4751000000000001e-05 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 97/34 ECSubWrite(tid=384, reqid=client.4553.0:814, at_version=97'131, trim_to=0'0, roll_forward_to=96'129))", 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:10.478146+0000", 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 10.054342646, 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012984268, 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478146+0000", 2024-09-17T16:43:20.624 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478146+0000", 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.625 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478147+0000", 2024-09-17T16:43:20.628 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8599999999999997e-07 2024-09-17T16:43:20.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.628 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.628 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478382+0000", 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00023487200000000001 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478398+0000", 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6061000000000001e-05 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478408+0000", 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2900000000000008e-06 2024-09-17T16:43:20.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478469+0000", 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.1828000000000005e-05 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.478485+0000", 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5857000000000001e-05 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.630 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.491086+0000", 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012601189 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:10.491131+0000", 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4285e-05 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs3 101/34 ECSubWrite(tid=424, reqid=client.4553.0:869, at_version=101'140, trim_to=0'0, roll_forward_to=100'138))", 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:14.491813+0000", 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 6.0406756130000003, 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015609517999999999, 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.491813+0000", 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.491813+0000", 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.491815+0000", 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.519e-06 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.492127+0000", 2024-09-17T16:43:20.633 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031168899999999998 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.492148+0000", 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.139e-05 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.492159+0000", 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0465000000000001e-05 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.634 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.492231+0000", 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2131000000000004e-05 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.492243+0000", 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2588999999999999e-05 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.507387+0000", 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015143383999999999 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:20.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:14.507423+0000", 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6350999999999998e-05 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:20.636 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:20.638 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:43:20.638 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:20.634+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:20.738 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:20.735+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:20.746 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:20.747 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 0 2024-09-17T16:43:20.748 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:20.755 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:43:20.840 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:20.836+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:20.858 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:20.858 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:20.859 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:20.859 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:20.867 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:43:20.940 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:20.938+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "size": 20, 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 600, 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.476464820999993, 2024-09-17T16:43:20.970 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.012796989999999999, 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:20.971 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.490633+0000", 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3699999999999999e-07 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492041+0000", 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0014080290000000001 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.972 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492061+0000", 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9678e-05 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492070+0000", 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4050000000000006e-06 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:20.973 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492139+0000", 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8300000000000007e-05 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.492148+0000", 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.7049999999999994e-06 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503396+0000", 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.011248081 2024-09-17T16:43:20.974 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.503430+0000", 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3555e-05 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=13, reqid=osd.11.0:13, at_version=40'11, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.469331062999998, 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078697639999999996, 2024-09-17T16:43:20.975 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:20.976 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497767+0000", 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8100000000000002e-07 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497784+0000", 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6585000000000001e-05 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.977 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497795+0000", 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0983e-05 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497803+0000", 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2209999999999997e-06 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497860+0000", 2024-09-17T16:43:20.978 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6886999999999999e-05 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.497870+0000", 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0091999999999999e-05 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505602+0000", 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0077316379999999999 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.979 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505636+0000", 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4677e-05 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 40/34 ECSubWrite(tid=68, reqid=client.4553.0:184, at_version=40'16, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.468139077999993, 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069241900000000002, 2024-09-17T16:43:20.980 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.981 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.498959+0000", 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4700000000000001e-07 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499112+0000", 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00015267500000000001 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:20.982 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499122+0000", 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0473e-05 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499130+0000", 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1799999999999999e-06 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499180+0000", 2024-09-17T16:43:20.983 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0114999999999997e-05 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499186+0000", 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5169999999999996e-06 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505852+0000", 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0066659800000000002 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.984 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505883+0000", 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0602999999999998e-05 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 40/34 ECSubWrite(tid=14, reqid=client.4553.0:206, at_version=40'12, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 67.467425043999995, 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0059870100000000001, 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:20.985 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.986 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499673+0000", 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.0100000000000005e-07 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499973+0000", 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00029958099999999999 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499984+0000", 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.08e-05 2024-09-17T16:43:20.987 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.499992+0000", 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.5210000000000002e-06 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500153+0000", 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00016087299999999999 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.988 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.500161+0000", 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1170000000000004e-06 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505641+0000", 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054796269999999999 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:13.505660+0000", 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.8989999999999999e-05 2024-09-17T16:43:20.989 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.990 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:20.990 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.990 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.990 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.990 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:20.990 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 61.455707785999998, 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061959889999999998, 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:20.991 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511390+0000", 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9900000000000002e-07 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.992 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511532+0000", 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00014124600000000001 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511545+0000", 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3609e-05 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511555+0000", 2024-09-17T16:43:20.993 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8220000000000002e-06 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511630+0000", 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4807000000000004e-05 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.511649+0000", 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9434000000000001e-05 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.994 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517548+0000", 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058984140000000003 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:19.517586+0000", 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8358000000000001e-05 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.995 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 50/34 ECSubWrite(tid=96, reqid=client.4553.0:295, at_version=50'27, trim_to=0'0, roll_forward_to=50'25))", 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 57.493554179999997, 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061901810000000003, 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.996 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473544+0000", 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.473545+0000", 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6160000000000001e-06 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.997 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474135+0000", 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000589867 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474152+0000", 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6772000000000001e-05 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474160+0000", 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6670000000000002e-06 2024-09-17T16:43:20.998 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474226+0000", 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5572000000000002e-05 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.474235+0000", 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8529999999999998e-06 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479694+0000", 2024-09-17T16:43:20.999 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0054593849999999998 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:23.479734+0000", 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9449000000000001e-05 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 55/34 ECSubWrite(tid=39, reqid=client.4553.0:386, at_version=55'14, trim_to=0'0, roll_forward_to=53'12))", 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:21.000 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 52.369111732999997, 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006518182, 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.001 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.597986+0000", 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9999999999999999e-07 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598219+0000", 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00023223800000000001 2024-09-17T16:43:21.002 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598246+0000", 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7399e-05 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598270+0000", 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.4323000000000001e-05 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.003 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598348+0000", 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.7309000000000001e-05 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.598364+0000", 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6724000000000001e-05 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604459+0000", 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060950049999999997 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.004 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:28.604504+0000", 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.4883999999999999e-05 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 61/34 ECSubWrite(tid=170, reqid=osd.4.0:170, at_version=61'65, trim_to=0'0, roll_forward_to=60'61))", 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 46.437477414999996, 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068917400000000004, 2024-09-17T16:43:21.005 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529620+0000", 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.006 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529621+0000", 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.8400000000000004e-07 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529638+0000", 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.7316000000000002e-05 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.007 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529650+0000", 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1790000000000001e-05 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529656+0000", 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.801e-06 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529702+0000", 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.6038999999999997e-05 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.008 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.529709+0000", 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4919999999999996e-06 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536483+0000", 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0067733170000000001 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.009 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:34.536512+0000", 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.9300999999999999e-05 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 82/77 ECSubWrite(tid=182, reqid=client.4553.0:643, at_version=82'82, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 25.487403067999999, 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073096100000000002, 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.010 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.011 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479695+0000", 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0299999999999998e-07 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479881+0000", 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00018565199999999999 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479896+0000", 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5038999999999999e-05 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.012 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479905+0000", 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1940000000000004e-06 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479963+0000", 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7911000000000002e-05 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.479974+0000", 2024-09-17T16:43:21.013 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0271e-05 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.486966+0000", 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0069925229999999996 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:42:55.487004+0000", 2024-09-17T16:43:21.014 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.8216999999999997e-05 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.ds1 91/77 ECSubWrite(tid=329, reqid=osd.4.0:329, at_version=91'16, trim_to=0'0, roll_forward_to=90'14))", 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.508872786000001, 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079773259999999999, 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.015 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458225+0000", 2024-09-17T16:43:21.016 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0899999999999997e-07 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458253+0000", 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7518999999999999e-05 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458263+0000", 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.9790000000000005e-06 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.017 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458272+0000", 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4099999999999997e-06 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458763+0000", 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00049112099999999996 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458773+0000", 2024-09-17T16:43:21.018 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0173000000000001e-05 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466157+0000", 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0073830600000000003 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466202+0000", 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.5754999999999998e-05 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.019 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.as1 91/77 ECSubWrite(tid=74, reqid=osd.8.0:74, at_version=91'58, trim_to=0'0, roll_forward_to=85'56))", 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.508725009999999, 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0078262980000000006, 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.020 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.021 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458373+0000", 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9000000000000001e-07 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458400+0000", 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6882000000000001e-05 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458411+0000", 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1304000000000001e-05 2024-09-17T16:43:21.022 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.458420+0000", 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.0890000000000006e-06 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459049+0000", 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00062910699999999995 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.023 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.459059+0000", 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.8390000000000002e-06 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466166+0000", 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0071070860000000003 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.466199+0000", 2024-09-17T16:43:21.024 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2801e-05 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.8s5 91/34 ECSubWrite(tid=58, reqid=client.4553.0:720, at_version=91'44, trim_to=0'0, roll_forward_to=85'42))", 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.505599779000001, 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0087023320000000001, 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.025 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.026 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461498+0000", 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.01e-07 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.027 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461630+0000", 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00013193699999999999 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461643+0000", 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.295e-05 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461653+0000", 2024-09-17T16:43:21.028 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.6709999999999994e-06 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461732+0000", 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.9746999999999994e-05 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.461744+0000", 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1513e-05 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.029 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470159+0000", 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0084150249999999996 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470200+0000", 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.1387999999999997e-05 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.030 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 91/77 ECSubWrite(tid=200, reqid=osd.2.0:199, at_version=0'0, trim_to=0'0, roll_forward_to=91'99))", 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:04.463940+0000", 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 16.503157404, 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006245736, 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463940+0000", 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.031 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463940+0000", 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463941+0000", 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8599999999999997e-07 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463951+0000", 2024-09-17T16:43:21.032 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0101999999999999e-05 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463964+0000", 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2628e-05 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.463970+0000", 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3219999999999998e-06 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.033 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.464034+0000", 2024-09-17T16:43:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.3356999999999997e-05 2024-09-17T16:43:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.036 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.464046+0000", 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2928000000000001e-05 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470147+0000", 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0061000409999999996 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.037 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:04.470186+0000", 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.9572e-05 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 96/34 ECSubWrite(tid=373, reqid=osd.4.0:373, at_version=96'127, trim_to=0'0, roll_forward_to=95'125))", 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.496909746, 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.006053971, 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.038 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.039 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470188+0000", 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0400000000000002e-07 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470219+0000", 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.0837000000000003e-05 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470233+0000", 2024-09-17T16:43:21.040 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4102e-05 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470244+0000", 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0662000000000001e-05 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470330+0000", 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6407000000000001e-05 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.041 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470343+0000", 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2680999999999999e-05 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476141+0000", 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0057983399999999999 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476242+0000", 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00010063799999999999 2024-09-17T16:43:21.042 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 96/77 ECSubWrite(tid=214, reqid=osd.2.0:213, at_version=0'0, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:09.470756+0000", 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 11.496342112000001, 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0060055309999999997, 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.043 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470756+0000", 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470756+0000", 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.044 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470757+0000", 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9599999999999998e-07 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470776+0000", 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9735999999999999e-05 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.045 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470788+0000", 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1508000000000001e-05 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470796+0000", 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.0360000000000006e-06 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470885+0000", 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9172999999999995e-05 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.046 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.470894+0000", 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2920000000000001e-06 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476729+0000", 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00583426 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:09.476761+0000", 2024-09-17T16:43:21.047 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.2629999999999998e-05 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 97/77 ECSubWrite(tid=215, reqid=client.4553.0:806, at_version=97'117, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.508288820000001, 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0085031619999999999, 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.048 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.049 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.458809+0000", 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5800000000000001e-07 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459133+0000", 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000324247 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459146+0000", 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2792999999999999e-05 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.050 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459162+0000", 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5546e-05 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459240+0000", 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.8681000000000001e-05 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.459255+0000", 2024-09-17T16:43:21.051 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4602e-05 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.467251+0000", 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0079958670000000003 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.467312+0000", 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.1267999999999997e-05 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.052 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 97/77 ECSubWrite(tid=216, reqid=client.4553.0:807, at_version=97'118, trim_to=0'0, roll_forward_to=96'115))", 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:10.464209+0000", 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.502888385, 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0068683950000000002, 2024-09-17T16:43:21.053 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464209+0000", 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464209+0000", 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.054 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464210+0000", 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6499999999999998e-07 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464495+0000", 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00028513200000000001 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.055 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464509+0000", 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.3644e-05 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464521+0000", 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2011000000000001e-05 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464585+0000", 2024-09-17T16:43:21.056 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.4358999999999998e-05 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.464593+0000", 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.1790000000000002e-06 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.471041+0000", 2024-09-17T16:43:21.057 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0064483229999999997 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.471078+0000", 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.6881999999999997e-05 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.es3 97/77 ECSubWrite(tid=218, reqid=client.4553.0:809, at_version=97'120, trim_to=0'0, roll_forward_to=97'117))", 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:10.472435+0000", 2024-09-17T16:43:21.058 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 10.494662792, 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0058915490000000003, 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472435+0000", 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.059 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472435+0000", 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472436+0000", 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4e-07 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.060 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472624+0000", 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.000187708 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472641+0000", 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6946e-05 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472652+0000", 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1759e-05 2024-09-17T16:43:21.061 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472711+0000", 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8780999999999998e-05 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.472731+0000", 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9666000000000001e-05 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.062 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.478300+0000", 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0055694480000000003 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:10.478327+0000", 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6301000000000001e-05 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.063 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.bs5 101/34 ECSubWrite(tid=424, reqid=client.4553.0:869, at_version=101'140, trim_to=0'0, roll_forward_to=100'138))", 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:14.499682+0000", 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.4674160790000004, 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0088842409999999993, 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.064 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.499682+0000", 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.499682+0000", 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.499683+0000", 2024-09-17T16:43:21.065 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1699999999999997e-07 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.500189+0000", 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00050659700000000002 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.500200+0000", 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1260999999999999e-05 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.066 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.067 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.500209+0000", 2024-09-17T16:43:21.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2570000000000007e-06 2024-09-17T16:43:21.070 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.070 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.070 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.070 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.500269+0000", 2024-09-17T16:43:21.070 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0143999999999999e-05 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.500278+0000", 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.9080000000000001e-06 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.508523+0000", 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0082448499999999997 2024-09-17T16:43:21.071 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.072 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.072 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.072 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.508566+0000", 2024-09-17T16:43:21.072 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.3306999999999997e-05 2024-09-17T16:43:21.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.073 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.073 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.073 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.073 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.074 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "MOSDECSubOpWrite(3.ds1 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:21.074 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:14.512800+0000", 2024-09-17T16:43:21.074 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 6.4542979430000003, 2024-09-17T16:43:21.074 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.028564051, 2024-09-17T16:43:21.074 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "reached pg", 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.512800+0000", 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.512800+0000", 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.075 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.512801+0000", 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.1999999999999998e-07 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.515307+0000", 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0025064509999999998 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.515326+0000", 2024-09-17T16:43:21.076 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9148999999999999e-05 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.515336+0000", 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.0164e-05 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.515394+0000", 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.7819999999999999e-05 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_started", 2024-09-17T16:43:21.077 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.515406+0000", 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.128e-05 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "sub_op_committed", 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.541330+0000", 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.025924655000000001 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "done", 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:14.541364+0000", 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.3612000000000003e-05 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.078 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.079 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.079 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.079 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:21.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:43:21.081 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:21.078+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:21.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:21.181 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:21.179+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:21.225 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [ 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:906 3.cs0 3.f8be803c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.461224+0000", 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.76227977899999999, 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.76229574, 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.226 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 906 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.461224+0000", 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.227 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.461224+0000", 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.461226+0000", 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1560000000000002e-06 2024-09-17T16:43:21.228 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.462224+0000", 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00099802099999999998 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.462239+0000", 2024-09-17T16:43:21.229 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5296999999999999e-05 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.462248+0000", 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6580000000000008e-06 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.462318+0000", 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0073999999999993e-05 2024-09-17T16:43:21.230 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.462322+0000", 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.4369999999999999e-06 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(osd.15.25:2 3.cs0 3.6ec2af9c (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.464241+0000", 2024-09-17T16:43:21.231 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75926312699999998, 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75931578600000005, 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464241+0000", 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.232 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464241+0000", 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464242+0000", 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.697e-06 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.233 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464247+0000", 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8459999999999999e-06 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464263+0000", 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.5458e-05 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464271+0000", 2024-09-17T16:43:21.234 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.6600000000000001e-06 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464337+0000", 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5296999999999995e-05 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.464338+0000", 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.858e-06 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.235 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:907 3.cs0 3.f8be803c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.465598+0000", 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75790617900000001, 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75798414999999997, 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.236 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 907 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.465598+0000", 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.237 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.238 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.238 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.465598+0000", 2024-09-17T16:43:21.238 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.465598+0000", 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.23e-07 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.240 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.466665+0000", 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.0010666880000000001 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.466678+0000", 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.2529e-05 2024-09-17T16:43:21.241 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.466686+0000", 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.2549999999999997e-06 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.466770+0000", 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.4536000000000005e-05 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.242 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.466773+0000", 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.7499999999999999e-06 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:908 3.cs0 3.f8be803c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.243 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.469882+0000", 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75362197900000005, 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.753727229, 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 908 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.244 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.469882+0000", 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.469882+0000", 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.245 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.469883+0000", 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.305e-06 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470763+0000", 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.00087976299999999999 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.246 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470783+0000", 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.9935000000000001e-05 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470791+0000", 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.371e-06 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.247 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470884+0000", 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.2801999999999997e-05 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470886+0000", 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.3259999999999998e-06 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.248 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:909 3.cs0 3.f8be803c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.470812+0000", 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75269148699999999, 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75282369900000001, 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.249 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 909 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470812+0000", 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.250 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470812+0000", 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470813+0000", 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 9.4600000000000003e-07 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.251 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470884+0000", 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.0988000000000005e-05 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470892+0000", 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.3209999999999999e-06 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470898+0000", 2024-09-17T16:43:21.252 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.0260000000000004e-06 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470951+0000", 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3004000000000003e-05 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470953+0000", 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.1710000000000001e-06 2024-09-17T16:43:21.253 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:910 3.cs0 3.f8be803c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.470912+0000", 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75259199399999999, 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75275101300000002, 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.254 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 910 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470912+0000", 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.255 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470912+0000", 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470912+0000", 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9100000000000003e-07 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.256 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470916+0000", 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 3.5209999999999998e-06 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470923+0000", 2024-09-17T16:43:21.257 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4510000000000003e-06 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470929+0000", 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6189999999999999e-06 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470984+0000", 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.4639999999999999e-05 2024-09-17T16:43:21.258 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470985+0000", 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.4079999999999999e-06 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.259 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:911 3.cs0 3.f8be803c (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.470939+0000", 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75256482400000002, 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75275066400000001, 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.260 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 911 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470939+0000", 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.261 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470939+0000", 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470939+0000", 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.3000000000000001e-07 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.262 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470942+0000", 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 2.6000000000000001e-06 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470949+0000", 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.5690000000000001e-06 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.263 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.470953+0000", 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 4.8099999999999997e-06 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.471012+0000", 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.8869000000000002e-05 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.471013+0000", 2024-09-17T16:43:21.264 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 7.4900000000000005e-07 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: "description": "osd_op(client.4553.0:912 3.cs0 3.d0ec847c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: "initiated_at": "2024-09-17T16:43:20.472439+0000", 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: "age": 0.75106474400000001, 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0.75130289800000005, 2024-09-17T16:43:21.265 INFO:teuthology.orchestra.run.smithi098.stdout: "continuous": false, 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "type_data": { 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "flag_point": "waiting for peered", 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client_info": { 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client": "client.4553", 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "tid": 912 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "events": [ 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "initiated", 2024-09-17T16:43:21.266 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472439+0000", 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "header_read", 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472439+0000", 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 0 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "throttled", 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472440+0000", 2024-09-17T16:43:21.267 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.8400000000000003e-07 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "all_read", 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472522+0000", 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 8.1749000000000006e-05 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.268 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "dispatched", 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472533+0000", 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.1783999999999999e-05 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "queued_for_pg", 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472539+0000", 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 5.6250000000000004e-06 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.269 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "reached_pg", 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472609+0000", 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 6.9949000000000004e-05 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: { 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: "event": "waiting for peered", 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: "time": "2024-09-17T16:43:20.472611+0000", 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: "duration": 1.6950000000000001e-06 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-17T16:43:21.270 INFO:teuthology.orchestra.run.smithi098.stdout: ], 2024-09-17T16:43:21.271 INFO:teuthology.orchestra.run.smithi098.stdout: "num_ops": 8 2024-09-17T16:43:21.271 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:21.272 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:43:21.282 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:21.278+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:21.296 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:21.313 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:21.313 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:21.331 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:21.331 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:21.348 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:21.348 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:21.364 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:21.364 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:21.375 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-17T16:43:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "ops": [], 2024-09-17T16:43:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "complaint_time": 30, 2024-09-17T16:43:21.375 INFO:teuthology.orchestra.run.smithi098.stdout: "num_blocked_ops": 0 2024-09-17T16:43:21.375 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-17T16:43:21.381 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:21.381 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:21.382 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:21.379+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:21.384 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:43:21.398 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:21.398 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:21.415 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:21.432 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:21.432 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:21.449 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:21.453 INFO:tasks.rados.rados.0.smithi183.stdout:366: done (3 left) 2024-09-17T16:43:21.453 INFO:tasks.rados.rados.0.smithi183.stdout:367: setattr oid 6 current snap is 36 2024-09-17T16:43:21.455 INFO:tasks.rados.rados.0.smithi183.stdout:368: read oid 50 snap -1 2024-09-17T16:43:21.455 INFO:tasks.rados.rados.0.smithi183.stdout:368: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-17T16:43:21.455 INFO:tasks.rados.rados.0.smithi183.stdout:369: snap_remove snap 35 2024-09-17T16:43:21.477 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:21.477 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:21.482 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:21.479+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:21.498 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:21.498 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:21.514 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:21.514 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:21.531 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:21.531 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:21.539 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:21.539 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:21.547 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:43:21.548 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:21.549 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:21.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:21.546+0000 7f23fb7fe640 0 -- 172.21.15.60:0/4266274140 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f23fc221fd0 msgr2=0x7f23fc2243c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:21.583 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:21.580+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:21.651 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:21.651 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:21.661 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:43:21.684 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:21.682+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:21.763 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:21.763 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:21.767 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:21.771 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:43:21.785 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:21.783+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:21.873 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:21.873 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:21.882 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:43:21.926 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:21.923+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:21.985 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:21.985 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:21.986 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:21.984+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:21.993 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:43:22.087 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:22.084+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:22.136 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.136 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:43:22.188 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:22.185+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:22.247 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.247 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.256 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:43:22.289 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:22.286+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:22.371 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.371 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:43:22.389 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:22.387+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:22.455 INFO:tasks.rados.rados.0.smithi183.stdout:369: done (5 left) 2024-09-17T16:43:22.455 INFO:tasks.rados.rados.0.smithi183.stdout:370: read oid 12 snap 33 2024-09-17T16:43:22.455 INFO:tasks.rados.rados.0.smithi183.stdout:370: expect deleted 2024-09-17T16:43:22.455 INFO:tasks.rados.rados.0.smithi183.stdout:371: snap_remove snap 28 2024-09-17T16:43:22.476 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 13] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:43:22.476 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:43:22.476 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T16:43:22.476 INFO:tasks.thrashosds.thrasher:Setting osd 13 primary_affinity to 0.000000 2024-09-17T16:43:22.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 0 2024-09-17T16:43:22.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:43:22.484 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.484 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.493 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:43:22.523 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:22.520+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:22.592 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:22.590+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:22.597 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.598 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.606 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:43:22.694 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:22.691+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:22.712 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.712 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:43:22.795 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:22.792+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:22.824 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.824 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.833 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:43:22.896 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:22.894+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:22.976 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:22.976 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:22.986 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:43:22.996 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:22.994+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:23.089 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.089 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.097 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:23.094+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:23.098 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:43:23.198 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:23.195+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:23.240 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.241 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.249 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:43:23.299 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:23.296+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:23.351 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.351 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.360 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:43:23.399 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:23.397+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:23.453 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.13 primary-affinity to 0 (802) 2024-09-17T16:43:23.454 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:43:23.457 INFO:tasks.rados.rados.0.smithi183.stdout:371: done (6 left) 2024-09-17T16:43:23.457 INFO:tasks.rados.rados.0.smithi183.stdout:372: snap_create 2024-09-17T16:43:23.457 INFO:tasks.rados.rados.0.smithi183.stdout:368: expect (ObjNum 0 snap 0 seq_num 0) 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 6 v 78 (ObjNum 132 snap 35 seq_num 132) dirty exists 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:363: finishing copy_from racing read to smithi18337221-3 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:364: finishing write tid 1 to smithi18337221-45 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:363: finishing copy_from to smithi18337221-3 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 3 v 12 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:364: finishing write tid 2 to smithi18337221-45 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:364: finishing write tid 3 to smithi18337221-45 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:364: finishing write tid 4 to smithi18337221-45 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:364: finishing write tid 5 to smithi18337221-45 2024-09-17T16:43:23.459 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 227 (ObjNum 135 snap 35 seq_num 135) dirty exists 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: finishing write tid 6 to smithi18337221-45 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: oid 45 updating version 0 to 223 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: oid 45 updating version 223 to 225 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: oid 45 version 225 is already newer than 224 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: oid 45 version 225 is already newer than 222 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: oid 45 updating version 225 to 226 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 45 v 226 (ObjNum 137 snap 35 seq_num 137) dirty exists 2024-09-17T16:43:23.460 INFO:tasks.rados.rados.0.smithi183.stdout:364: left oid 45 (ObjNum 137 snap 35 seq_num 137) 2024-09-17T16:43:23.473 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.474 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.484 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:43:23.528 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:23.525+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:23.587 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.587 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.596 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:43:23.601 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:23.599+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:23.699 INFO:teuthology.orchestra.run.smithi111.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.699 INFO:teuthology.orchestra.run.smithi111.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.702 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:23.699+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:23.708 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:43:23.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:43:23.802 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:23.799+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:23.817 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.817 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.826 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:43:23.903 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:23.901+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:23.916 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:23.916 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:23.929 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:23.929 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:23.934 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:23.935 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:23.937 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:43:23.952 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:23.952 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:23.969 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:23.969 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:23.985 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:23.986 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:24.004 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:24.001+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:24.004 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:24.004 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:24.021 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:24.021 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:24.038 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:24.038 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:24.054 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:24.054 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:24.071 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:24.071 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:24.081 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:24.081 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:24.081 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:24.081 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:24.081 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.081 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 70.595704415, 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074612999999999997, 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.082 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.083 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482439+0000", 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7199999999999998e-07 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482462+0000", 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2668e-05 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482473+0000", 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482481+0000", 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6130000000000004e-06 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486671+0000", 2024-09-17T16:43:24.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041899479999999998 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486680+0000", 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8869999999999998e-06 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489834+0000", 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031540069999999999 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489899+0000", 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5050999999999998e-05 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:43:24.087 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 70.594994378999999, 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008086981, 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483149+0000", 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483164+0000", 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.523e-05 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483175+0000", 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0876999999999999e-05 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483181+0000", 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3029999999999996e-06 2024-09-17T16:43:24.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488038+0000", 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048566149999999999 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488047+0000", 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3070000000000008e-06 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491189+0000", 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031416790000000001 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491235+0000", 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6241e-05 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 70.585555667999998, 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013185944, 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:24.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492588+0000", 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7600000000000006e-07 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493009+0000", 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042131299999999998 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493025+0000", 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5605000000000001e-05 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493033+0000", 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.32e-06 2024-09-17T16:43:24.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1038000000000006e-05 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493124+0000", 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4909999999999994e-06 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505727+0000", 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012603346 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505773+0000", 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5855000000000001e-05 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 70.579606706000007, 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071885259999999998, 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.098 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498537+0000", 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498559+0000", 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2444000000000001e-05 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498576+0000", 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7067000000000001e-05 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0920000000000004e-06 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498675+0000", 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9314999999999994e-05 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498682+0000", 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8699999999999992e-06 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505669+0000", 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069863959999999998 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505724+0000", 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5414999999999997e-05 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.102 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 55.573340766000001, 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083741470000000002, 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504803+0000", 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9100000000000002e-07 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505695+0000", 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089272400000000001 2024-09-17T16:43:24.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505712+0000", 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6320999999999998e-05 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505720+0000", 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6780000000000006e-06 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505787+0000", 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6303000000000005e-05 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505797+0000", 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0455000000000001e-05 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513105+0000", 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007307717 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513176+0000", 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1057999999999996e-05 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.559754126999998, 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016246389999999999, 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.107 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518389+0000", 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.51e-07 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518980+0000", 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059100999999999999 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519003+0000", 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2819999999999998e-05 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519012+0000", 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519183+0000", 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017095399999999999 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519194+0000", 2024-09-17T16:43:24.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.102e-05 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534599+0000", 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015404927000000001 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534635+0000", 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5364000000000002e-05 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.552018756999999, 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085642229999999993, 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.112 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526125+0000", 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999999e-07 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526311+0000", 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018657999999999999 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526341+0000", 2024-09-17T16:43:24.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9788999999999999e-05 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526352+0000", 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1379999999999999e-05 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527177+0000", 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082429900000000002 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527187+0000", 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.06e-05 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534665+0000", 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074776570000000004 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534688+0000", 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2994999999999999e-05 2024-09-17T16:43:24.116 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=150, reqid=osd.5.0:150, at_version=61'95, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 49.567522158000003, 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071525119999999998, 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510621+0000", 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4099999999999997e-07 2024-09-17T16:43:24.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510647+0000", 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5749999999999999e-05 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510664+0000", 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7388999999999999e-05 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510674+0000", 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0011e-05 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510769+0000", 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4370999999999995e-05 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510779+0000", 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0302999999999999e-05 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517731+0000", 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069523679999999996 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517773+0000", 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1378999999999998e-05 2024-09-17T16:43:24.121 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=151, reqid=client.4553.0:467, at_version=61'97, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 49.565211615000003, 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0096697429999999997, 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.122 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512932+0000", 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512962+0000", 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0382000000000002e-05 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512978+0000", 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6013000000000001e-05 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512997+0000", 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8839999999999999e-05 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513153+0000", 2024-09-17T16:43:24.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000155969 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513163+0000", 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.031e-05 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522566+0000", 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094027599999999996 2024-09-17T16:43:24.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522601+0000", 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4542000000000002e-05 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:24.127 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.621824750000002, 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017286182000000001, 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.128 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0900000000000001e-07 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457450+0000", 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011316200000000001 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457466+0000", 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6240999999999999e-05 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457479+0000", 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2836e-05 2024-09-17T16:43:24.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457584+0000", 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000105493 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457594+0000", 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6059999999999992e-06 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473552+0000", 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015957846000000001 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473604+0000", 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2330999999999998e-05 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.616747785000001, 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012610367000000001, 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461396+0000", 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461793+0000", 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039774400000000001 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461808+0000", 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4939999999999999e-05 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461849+0000", 2024-09-17T16:43:24.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0674999999999999e-05 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.462239+0000", 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038960600000000002 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.462251+0000", 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2116999999999999e-05 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473961+0000", 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011710010999999999 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474005+0000", 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4308999999999999e-05 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:24.138 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.611940397000001, 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079189910000000002, 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466203+0000", 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.291e-06 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466601+0000", 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039756699999999998 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466621+0000", 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0288999999999998e-05 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466656+0000", 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4671000000000001e-05 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.468123+0000", 2024-09-17T16:43:24.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014669419999999999 2024-09-17T16:43:24.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.468133+0000", 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6849999999999996e-06 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474092+0000", 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005959509 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474121+0000", 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9037e-05 2024-09-17T16:43:24.143 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 82/77 ECSubWrite(tid=100, reqid=client.4553.0:656, at_version=82'22, trim_to=0'0, roll_forward_to=78'19))", 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.416136588000001, 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010050554, 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662007+0000", 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5999999999999991e-07 2024-09-17T16:43:24.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662470+0000", 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046351299999999998 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662481+0000", 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0638999999999999e-05 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662489+0000", 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0460000000000006e-06 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662551+0000", 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2383000000000002e-05 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662563+0000", 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1483e-05 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.672026+0000", 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094634090000000008 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.672056+0000", 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0120999999999998e-05 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.148 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.3s3 96/77 ECSubWrite(tid=70, reqid=osd.15.0:70, at_version=96'44, trim_to=0'0, roll_forward_to=95'42))", 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.613205796999999, 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080907759999999992, 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.149 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9299999999999999e-07 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464963+0000", 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6245999999999999e-05 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464976+0000", 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2801e-05 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464997+0000", 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0381999999999999e-05 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465087+0000", 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0882000000000002e-05 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465099+0000", 2024-09-17T16:43:24.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2065000000000001e-05 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472973+0000", 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078740049999999999 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.473027+0000", 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4002000000000002e-05 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.153 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.612973818, 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019745841, 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6499999999999998e-07 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466510+0000", 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001340489 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466529+0000", 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9086999999999999e-05 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466540+0000", 2024-09-17T16:43:24.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0669000000000001e-05 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466609+0000", 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9511000000000006e-05 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466619+0000", 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0059e-05 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484852+0000", 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018232578999999999 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484915+0000", 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2681999999999994e-05 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.607456411999999, 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014254615, 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.159 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470687+0000", 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1200000000000001e-06 2024-09-17T16:43:24.160 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472739+0000", 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0020515249999999998 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472755+0000", 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6776999999999999e-05 2024-09-17T16:43:24.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472766+0000", 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0015e-05 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472932+0000", 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016676500000000001 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472944+0000", 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1749999999999999e-05 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484921+0000", 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011976686 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484941+0000", 2024-09-17T16:43:24.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9976999999999999e-05 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.600084802, 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077763559999999999, 2024-09-17T16:43:24.164 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7000000000000004e-07 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478380+0000", 2024-09-17T16:43:24.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032185200000000002 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478395+0000", 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4484000000000001e-05 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478413+0000", 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7961999999999998e-05 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478717+0000", 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00030417999999999998 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478728+0000", 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0662000000000001e-05 2024-09-17T16:43:24.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.485798+0000", 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070707010000000004 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.485834+0000", 2024-09-17T16:43:24.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5744999999999997e-05 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=82, reqid=client.4553.0:799, at_version=96'42, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.597537683000001, 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014298085, 2024-09-17T16:43:24.170 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.171 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480606+0000", 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.096e-06 2024-09-17T16:43:24.172 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481691+0000", 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010850689999999999 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481709+0000", 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8060999999999999e-05 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481718+0000", 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3000000000000007e-06 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481783+0000", 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4850000000000004e-05 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481793+0000", 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7149999999999993e-06 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494862+0000", 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013069404 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494903+0000", 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0590000000000003e-05 2024-09-17T16:43:24.175 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=83, reqid=client.4553.0:800, at_version=96'43, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.590722375, 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080848599999999993, 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487421+0000", 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0979999999999999e-06 2024-09-17T16:43:24.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488035+0000", 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000613376 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488071+0000", 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6551999999999998e-05 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488079+0000", 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3070000000000003e-06 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488154+0000", 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4250000000000002e-05 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488162+0000", 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8960000000000003e-06 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495348+0000", 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071863839999999997 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495505+0000", 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156997 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.180 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=84, reqid=client.4553.0:801, at_version=96'44, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.582742829000001, 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.009364509, 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:24.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0500000000000003e-07 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495948+0000", 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00054791099999999999 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495963+0000", 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4569999999999999e-05 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495971+0000", 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6200000000000005e-06 2024-09-17T16:43:24.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496056+0000", 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4425000000000006e-05 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496065+0000", 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2420000000000006e-06 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504716+0000", 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086504779999999996 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504764+0000", 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8557999999999998e-05 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.185 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:24.186 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:24.187 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:24.188 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:43:24.189 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:24.189 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:24.190 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:24.190 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:24.190 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:24.191 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:24.191 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:24.183+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:24.288 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:24.286+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:24.294 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:24.294 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:24.294 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:24.294 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:24.305 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:43:24.389 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:24.386+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:24.447 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:24.448 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:24.448 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:24.448 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:24.448 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:24.456 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:43:24.459 INFO:tasks.rados.rados.0.smithi183.stdout:363: done (6 left) 2024-09-17T16:43:24.459 INFO:tasks.rados.rados.0.smithi183.stdout:364: done (5 left) 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:365: done (4 left) 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:367: done (3 left) 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:368: done (2 left) 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:370: done (1 left) 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:372: done (0 left) 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:373: rmattr oid 27 current snap is 37 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:374: copy_from oid 15 from oid 47 current snap is 37 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 12 current snap is 37 2024-09-17T16:43:24.460 INFO:tasks.rados.rados.0.smithi183.stdout:375: seq_num 138 ranges {0=770048,770048=540672,1310720=753664,2064384=262144} 2024-09-17T16:43:24.463 INFO:tasks.rados.rados.0.smithi183.stdout:375: writing smithi18337221-12 from 0 to 770048 tid 1 2024-09-17T16:43:24.467 INFO:tasks.rados.rados.0.smithi183.stdout:375: writing smithi18337221-12 from 770048 to 1310720 tid 2 2024-09-17T16:43:24.472 INFO:tasks.rados.rados.0.smithi183.stdout:375: writing smithi18337221-12 from 1310720 to 2064384 tid 3 2024-09-17T16:43:24.474 INFO:tasks.rados.rados.0.smithi183.stdout:375: writing smithi18337221-12 from 2064384 to 2326528 tid 4 2024-09-17T16:43:24.474 INFO:tasks.rados.rados.0.smithi183.stdout:376: read oid 4 snap 36 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:376: expect (ObjNum 127 snap 35 seq_num 127) 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:377: rollback oid 28 current snap is 37 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 28 to 33 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 27 v 0 (ObjNum 129 snap 0 seq_num 470935664) dirty dne 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:373: done (4 left) 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:378: setattr oid 38 current snap is 37 2024-09-17T16:43:24.475 INFO:tasks.rados.rados.0.smithi183.stdout:379: snap_create 2024-09-17T16:43:24.479 INFO:tasks.rados.rados.0.smithi183.stdout:377: finishing rollback tid 0 to smithi18337221-28 2024-09-17T16:43:24.480 INFO:tasks.rados.rados.0.smithi183.stdout:377: finishing rollback tid 1 to smithi18337221-28 2024-09-17T16:43:24.480 INFO:tasks.rados.rados.0.smithi183.stdout:377: finishing rollback tid 2 to smithi18337221-28 2024-09-17T16:43:24.480 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 28 v 239 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-09-17T16:43:24.481 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 38 v 58 (ObjNum 100 snap 21 seq_num 100) dirty exists 2024-09-17T16:43:24.489 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:24.487+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:24.491 INFO:tasks.rados.rados.0.smithi183.stdout:374: finishing copy_from racing read to smithi18337221-15 2024-09-17T16:43:24.492 INFO:tasks.rados.rados.0.smithi183.stdout:374: finishing copy_from to smithi18337221-15 2024-09-17T16:43:24.492 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 15 v 117 (ObjNum 111 snap 26 seq_num 111) dirty exists 2024-09-17T16:43:24.494 INFO:tasks.rados.rados.0.smithi183.stdout:375: finishing write tid 1 to smithi18337221-12 2024-09-17T16:43:24.495 INFO:tasks.rados.rados.0.smithi183.stdout:375: finishing write tid 2 to smithi18337221-12 2024-09-17T16:43:24.495 INFO:tasks.rados.rados.0.smithi183.stdout:375: finishing write tid 3 to smithi18337221-12 2024-09-17T16:43:24.496 INFO:tasks.rados.rados.0.smithi183.stdout:375: finishing write tid 4 to smithi18337221-12 2024-09-17T16:43:24.497 INFO:tasks.rados.rados.0.smithi183.stdout:375: finishing write tid 5 to smithi18337221-12 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: finishing write tid 6 to smithi18337221-12 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: oid 12 updating version 0 to 164 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: oid 12 updating version 164 to 165 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: oid 12 version 165 is already newer than 163 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: oid 12 version 165 is already newer than 162 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: oid 12 version 165 is already newer than 161 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 12 v 165 (ObjNum 138 snap 37 seq_num 138) dirty exists 2024-09-17T16:43:24.504 INFO:tasks.rados.rados.0.smithi183.stdout:375: left oid 12 (ObjNum 138 snap 37 seq_num 138) 2024-09-17T16:43:24.508 INFO:tasks.rados.rados.0.smithi183.stdout:376: expect (ObjNum 127 snap 35 seq_num 127) 2024-09-17T16:43:24.508 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:24.571 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:24.571 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:24.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:24.571 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 40/34 ECSubWrite(tid=61, reqid=client.4553.0:183, at_version=40'15, trim_to=0'0, roll_forward_to=37'13))", 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 71.086510989999994, 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079208060000000007, 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481602+0000", 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.481603+0000", 2024-09-17T16:43:24.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.75e-07 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482071+0000", 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046812600000000002 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482084+0000", 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3057000000000001e-05 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.574 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482091+0000", 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3540000000000002e-06 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482223+0000", 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013139799999999999 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482253+0000", 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0824000000000002e-05 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489462+0000", 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007208356 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489523+0000", 2024-09-17T16:43:24.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1216000000000005e-05 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.056888714999999, 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081810830000000005, 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.577 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511224+0000", 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511225+0000", 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7099999999999998e-07 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511251+0000", 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6346000000000002e-05 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511262+0000", 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0501e-05 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511272+0000", 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9690000000000006e-06 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511337+0000", 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5390999999999998e-05 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511347+0000", 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8840000000000006e-06 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519366+0000", 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080189979999999994 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.581 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519406+0000", 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9722999999999999e-05 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.049803961999999, 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015298559, 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.582 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518309+0000", 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518310+0000", 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.049e-06 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518764+0000", 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045328799999999999 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518781+0000", 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6999000000000001e-05 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518789+0000", 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8000000000000004e-06 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518864+0000", 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4679999999999996e-05 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518876+0000", 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1732e-05 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533579+0000", 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014703163 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.533608+0000", 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8847999999999999e-05 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.586 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.978478926000001, 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010959406, 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589634+0000", 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589635+0000", 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590206+0000", 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000570752 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590220+0000", 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4301000000000001e-05 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590226+0000", 2024-09-17T16:43:24.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1279999999999996e-06 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590291+0000", 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4098999999999997e-05 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590299+0000", 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3659999999999992e-06 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600554+0000", 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010255060999999999 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.600594+0000", 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9734000000000003e-05 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.591 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 60/34 ECSubWrite(tid=49, reqid=client.4553.0:455, at_version=60'43, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.973774055, 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077480170000000003, 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594339+0000", 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594340+0000", 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7199999999999998e-07 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594802+0000", 2024-09-17T16:43:24.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046238699999999998 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594812+0000", 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4490000000000005e-06 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594817+0000", 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4070000000000001e-06 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594873+0000", 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.6187000000000003e-05 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.594883+0000", 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0012e-05 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602063+0000", 2024-09-17T16:43:24.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071793839999999996 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.602087+0000", 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4519e-05 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.fs4 61/34 ECSubWrite(tid=57, reqid=osd.13.0:57, at_version=61'8, trim_to=0'0, roll_forward_to=60'6))", 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:24.596 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.052258883, 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079238329999999999, 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515854+0000", 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515855+0000", 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.39e-07 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515885+0000", 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0670999999999998e-05 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515896+0000", 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0227999999999999e-05 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.515904+0000", 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516079+0000", 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017482700000000001 2024-09-17T16:43:24.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516092+0000", 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2476e-05 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523739+0000", 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076475459999999999 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.523778+0000", 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8964999999999997e-05 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 61/34 ECSubWrite(tid=56, reqid=osd.13.0:56, at_version=61'23, trim_to=0'0, roll_forward_to=60'21))", 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 50.051716876999997, 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0081842100000000008, 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.601 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516396+0000", 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516397+0000", 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.71e-07 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516421+0000", 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4227e-05 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516436+0000", 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4278e-05 2024-09-17T16:43:24.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516446+0000", 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0132999999999999e-05 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516504+0000", 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8096000000000001e-05 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.604 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.516511+0000", 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5930000000000002e-06 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524540+0000", 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080295439999999996 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.524581+0000", 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0467999999999999e-05 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.605 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 46.113855745999999, 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0088600729999999996, 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454257+0000", 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.454258+0000", 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9299999999999997e-07 2024-09-17T16:43:24.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455027+0000", 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00076834799999999997 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455042+0000", 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5009e-05 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455048+0000", 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6560000000000003e-06 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0324e-05 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.455119+0000", 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0755e-05 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463081+0000", 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079613089999999997 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:38.463118+0000", 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6878999999999997e-05 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.610 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.as2 82/77 ECSubWrite(tid=55, reqid=client.4553.0:669, at_version=82'41, trim_to=0'0, roll_forward_to=0'0))", 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 28.888088357000001, 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082065909999999992, 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680025+0000", 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.36e-07 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680539+0000", 2024-09-17T16:43:24.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051415599999999999 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680553+0000", 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3949e-05 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680561+0000", 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.926e-06 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680619+0000", 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8400000000000003e-05 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.680628+0000", 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7290000000000006e-06 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.688193+0000", 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00756495 2024-09-17T16:43:24.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.688231+0000", 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8345e-05 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 25.038527374000001, 2024-09-17T16:43:24.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0084683799999999993, 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529586+0000", 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.529587+0000", 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.153e-06 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530391+0000", 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00080430200000000001 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530407+0000", 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5998000000000002e-05 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530416+0000", 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1700000000000003e-06 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530479+0000", 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2488000000000002e-05 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.530490+0000", 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0764000000000001e-05 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.538031+0000", 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075414239999999997 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:59.538054+0000", 2024-09-17T16:43:24.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3081000000000001e-05 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:05.469815+0000", 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 19.098297973000001, 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017103197000000001, 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.620 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.469815+0000", 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.469815+0000", 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.469816+0000", 2024-09-17T16:43:24.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9400000000000001e-07 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472623+0000", 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028072420000000002 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472634+0000", 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1291000000000001e-05 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472658+0000", 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3969999999999999e-05 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472726+0000", 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7671999999999999e-05 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472735+0000", 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6730000000000004e-06 2024-09-17T16:43:24.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.486878+0000", 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014142531 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.486918+0000", 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0423999999999998e-05 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 96/34 ECSubWrite(tid=90, reqid=client.4553.0:781, at_version=96'81, trim_to=0'0, roll_forward_to=95'78))", 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.459080+0000", 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.109033258, 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0076332079999999998, 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459080+0000", 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.625 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459080+0000", 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459081+0000", 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2470000000000001e-06 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459118+0000", 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6483999999999998e-05 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459136+0000", 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8505999999999999e-05 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459147+0000", 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0508e-05 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459213+0000", 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6267999999999996e-05 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459228+0000", 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4714e-05 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466621+0000", 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0073931969999999998 2024-09-17T16:43:24.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466713+0000", 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2283999999999999e-05 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 96/77 ECSubWrite(tid=369, reqid=osd.4.0:369, at_version=96'90, trim_to=0'0, roll_forward_to=95'88))", 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.108725593999999, 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085276350000000004, 2024-09-17T16:43:24.629 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459388+0000", 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5699999999999998e-07 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459412+0000", 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3810000000000001e-05 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459470+0000", 2024-09-17T16:43:24.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7849999999999997e-05 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459477+0000", 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4869999999999996e-06 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459571+0000", 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3789999999999995e-05 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459582+0000", 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0675e-05 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467874+0000", 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0082924409999999994 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467915+0000", 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1224999999999999e-05 2024-09-17T16:43:24.633 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s1 96/34 ECSubWrite(tid=92, reqid=client.4553.0:792, at_version=96'84, trim_to=0'0, roll_forward_to=95'78))", 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.464015+0000", 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.104098496000001, 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078069869999999996, 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.634 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464015+0000", 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464015+0000", 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464016+0000", 2024-09-17T16:43:24.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.159e-06 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464078+0000", 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2198000000000003e-05 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464100+0000", 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1622999999999999e-05 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464110+0000", 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8730000000000002e-06 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464218+0000", 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010807900000000001 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464229+0000", 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0934999999999999e-05 2024-09-17T16:43:24.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471761+0000", 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007532815 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471822+0000", 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0304999999999999e-05 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.466279+0000", 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.101833993, 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012657313999999999, 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466279+0000", 2024-09-17T16:43:24.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466279+0000", 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466281+0000", 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.567e-06 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467073+0000", 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00079186999999999997 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467090+0000", 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7747000000000001e-05 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467100+0000", 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8339999999999994e-06 2024-09-17T16:43:24.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467191+0000", 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1209e-05 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467202+0000", 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0139999999999999e-05 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478897+0000", 2024-09-17T16:43:24.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011695008999999999 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478937+0000", 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9938000000000003e-05 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.470478+0000", 2024-09-17T16:43:24.643 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.097634811000001, 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015879730000000002, 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470478+0000", 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470478+0000", 2024-09-17T16:43:24.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470479+0000", 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470661+0000", 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018251300000000001 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470672+0000", 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0900999999999999e-05 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470680+0000", 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8669999999999994e-06 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472527+0000", 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0018469440000000001 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472536+0000", 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1419999999999999e-06 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.486311+0000", 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013774606 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.486358+0000", 2024-09-17T16:43:24.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.7298e-05 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s6 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.478955+0000", 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.089157808, 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010500262, 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.648 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478955+0000", 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478955+0000", 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478956+0000", 2024-09-17T16:43:24.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.7300000000000005e-07 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479148+0000", 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000192122 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479184+0000", 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5651999999999997e-05 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.650 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479202+0000", 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8212000000000001e-05 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479281+0000", 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8427e-05 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479290+0000", 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3919999999999992e-06 2024-09-17T16:43:24.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.489421+0000", 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010131127 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.489456+0000", 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4456999999999999e-05 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s2 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.088853406, 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.023017270999999999, 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:24.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479260+0000", 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8699999999999995e-07 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479850+0000", 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059002700000000002 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479863+0000", 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2609000000000001e-05 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479871+0000", 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6179999999999997e-06 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479947+0000", 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6769999999999999e-05 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479959+0000", 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1384e-05 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502238+0000", 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022279576999999998 2024-09-17T16:43:24.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502277+0000", 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.8798999999999999e-05 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 97/34 ECSubWrite(tid=388, reqid=client.4553.0:815, at_version=97'132, trim_to=0'0, roll_forward_to=97'130))", 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:10.484836+0000", 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 14.083277263999999, 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078964440000000007, 2024-09-17T16:43:24.657 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.484836+0000", 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.484836+0000", 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.484837+0000", 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.16e-07 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485040+0000", 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00020355899999999999 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485053+0000", 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3132000000000001e-05 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485059+0000", 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9340000000000003e-06 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485121+0000", 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1911999999999999e-05 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.485132+0000", 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0831e-05 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.492699+0000", 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0075671799999999997 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:10.492732+0000", 2024-09-17T16:43:24.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3080000000000002e-05 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs6 101/34 ECSubWrite(tid=424, reqid=client.4553.0:869, at_version=101'140, trim_to=0'0, roll_forward_to=100'138))", 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:14.492307+0000", 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.075806264000001, 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014342746999999999, 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:24.662 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.492307+0000", 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.492307+0000", 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:24.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.492308+0000", 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1399999999999995e-07 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495491+0000", 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031835230000000002 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495505+0000", 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3767e-05 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495514+0000", 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.149e-06 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495588+0000", 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3872e-05 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495601+0000", 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.276e-05 2024-09-17T16:43:24.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.506608+0000", 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011006587 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.506650+0000", 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2175000000000002e-05 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.666 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:24.667 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:24.667 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:24.668 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 3494549 2024-09-17T16:43:24.669 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:43:24.669 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:24.669 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:24.665+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:24.769 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:24.766+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:24.815 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:24.816 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:24.816 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:24.816 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:24.824 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:43:24.870 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:24.868+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:24.927 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:24.928 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:24.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:43:24.971 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:24.969+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:25.073 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:25.070+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:25.081 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:25.081 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4353.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 89.963309116000005, 2024-09-17T16:43:25.082 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019887846000000001, 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4353", 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.60:0/4131644644", 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 1 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.083 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114601+0000", 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114602+0000", 2024-09-17T16:43:25.084 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4899999999999999e-06 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114608+0000", 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5269999999999998e-06 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114617+0000", 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8799999999999997e-06 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.085 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114624+0000", 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6340000000000001e-06 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114751+0000", 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012672599999999999 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.086 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for peered", 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.114762+0000", 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0988000000000001e-05 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133140+0000", 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018378205000000002 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.087 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133255+0000", 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011454 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for subops from 5", 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.133361+0000", 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000106 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.088 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op_commit", 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134291+0000", 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00092989899999999998 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_commit_rec", 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134428+0000", 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013742100000000001 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134460+0000", 2024-09-17T16:43:25.089 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1696000000000003e-05 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:41:55.134488+0000", 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.8839999999999998e-05 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:180 3.8s0 3:1f669f2f:::smithi18337221-38:head [copy-from ver 4] snapc 3=[3,2] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 72.617365739999997, 2024-09-17T16:43:25.090 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539511, 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 180 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.091 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460544+0000", 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460545+0000", 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4789999999999999e-06 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460557+0000", 2024-09-17T16:43:25.092 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1426e-05 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460574+0000", 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7201e-05 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460585+0000", 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1151e-05 2024-09-17T16:43:25.093 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460659+0000", 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3627000000000005e-05 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.460665+0000", 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.8799999999999996e-06 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.094 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465756+0000", 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0050914580000000001 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.465824+0000", 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.7695999999999997e-05 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.471499+0000", 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0056752800000000004 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.095 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.474733+0000", 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032336159999999999 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475885+0000", 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011522209999999999 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:12.475939+0000", 2024-09-17T16:43:25.096 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4075e-05 2024-09-17T16:43:25.097 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.097 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.097 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.097 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.097 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.097 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:205 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~540672] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 71.591305851000001, 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.022798883999999998, 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 205 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.098 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486604+0000", 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486616+0000", 2024-09-17T16:43:25.099 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2235999999999999e-05 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487273+0000", 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00065649800000000004 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487287+0000", 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4691e-05 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.100 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.487297+0000", 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6360000000000006e-06 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488723+0000", 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014264239999999999 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488837+0000", 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011340000000000001 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.101 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490257+0000", 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014198100000000001 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.503813+0000", 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013556586000000001 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509302+0000", 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054885029999999996 2024-09-17T16:43:25.102 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509403+0000", 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0001011 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:206 3.8s0 3:1b608a02:::smithi18337221-50:head [append 0~376832] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 71.588125343000002, 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020001278000000001, 2024-09-17T16:43:25.103 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 206 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:43:25.104 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489784+0000", 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489787+0000", 2024-09-17T16:43:25.105 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.193e-06 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490081+0000", 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029397100000000002 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490112+0000", 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1084999999999998e-05 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.106 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490123+0000", 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1440999999999999e-05 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498510+0000", 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083867290000000008 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.107 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498626+0000", 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011602700000000001 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.499572+0000", 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00094589999999999995 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.504786+0000", 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005214148 2024-09-17T16:43:25.108 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509716+0000", 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0049301520000000001 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.509786+0000", 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9632e-05 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.109 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:207 3.8s0 3:1b608a02:::smithi18337221-50:head [setxattr _header (56) in=7b] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 71.587767162000006, 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020510362000000001, 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 207 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.110 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490143+0000", 2024-09-17T16:43:25.111 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1800000000000004e-07 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490149+0000", 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.135e-06 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490157+0000", 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9060000000000002e-06 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.112 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490162+0000", 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1229999999999999e-06 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505559+0000", 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01539709 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505695+0000", 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000135969 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.113 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506337+0000", 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00064216000000000002 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507545+0000", 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0012081609999999999 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510574+0000", 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030285519999999999 2024-09-17T16:43:25.114 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510653+0000", 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9348e-05 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:208 3.8s0 3:1b608a02:::smithi18337221-50:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 71.587739100999997, 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.021610111000000001, 2024-09-17T16:43:25.115 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 208 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.116 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.117 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490171+0000", 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5199999999999997e-07 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490174+0000", 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7350000000000001e-06 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490181+0000", 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9890000000000003e-06 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.118 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.490186+0000", 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2299999999999999e-06 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.506594+0000", 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016408049000000001 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.507224+0000", 2024-09-17T16:43:25.119 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000629881 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.510953+0000", 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037285399999999998 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511114+0000", 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016097400000000001 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.120 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.511781+0000", 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066716099999999999 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:43:25.121 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.559203275999998, 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01393165, 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.122 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518706+0000", 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518707+0000", 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.47e-07 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519373+0000", 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00066530699999999996 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.123 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519390+0000", 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7329e-05 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519407+0000", 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7022999999999999e-05 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519617+0000", 2024-09-17T16:43:25.124 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000209564 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519641+0000", 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4725000000000001e-05 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532562+0000", 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012920769 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.125 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.532638+0000", 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5986000000000001e-05 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.126 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.128 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:720 3.8s0 3:1f669f2f:::smithi18337221-38:head [create,setxattr og^`]cfbTbdPrNph_pkYgeiTrgatpl] (805) in=31b,setxattr `Trb[\\aaaksnX\\dQOYP^TPXpYtmQ_maX\\[hbePkT (981) in=40b,setxattr UkQ^W[[sWh]fSrWg]^\\oZpWaamVkVUnZYbR[Vql\\ (663) in=40b,setxattr ofr[Os^]tjr^jicnNpPaUeXQTfldVQPdSPjcgWcT (7228) in=40b,setxattr Vl`NPsTVpnj_gO_srrbrZ\\eq (805) in=24b,setxattr ^_mcpljcT[qX_UeeYZY\\_ZTSsSsojP\\esUkVphT] (1963) in=40b,setxattr [oY^bSn[ealaPaOhprWW_SNaa]VhaXN[jmo`YYgt (138) in=40b,setxattr tT[SSseaPa\\UPS`\\g\\pRqsd`^lo__arabQlQmob` (663) in=40b,setxattr o^\\]jXsesZhoknr\\dagnjidgsPOhkfg[ffVe[PQW (1259) in=40b,setxattr c^VX_^n^gsh^P`aVbXpaS\\cgkpZO]OmXmchTtWZd (1612) in=40b,setxattr _^aeiTb[Uhh`rNNUOZOPt_Z_Qmeps`XXQ^qidetf (629) in=40b,setxattr ms[glaQ`N\\pqbicVTmgp^\\Rg]h`fefatkfg\\js_[ (139) in=40b,setxattr O\\gsPtYmrReq]if[pkOgPtqS`]Nrq_eYpsefkSgl (700) in=40b,setxattr RgefRtSsOT`jTQb^h\\igU`_lbscW`fgkXroNdmea (1751) in=40b,setxattr sgaV_cSaelbWQYill^k`RsVajcXpUSfW]eNd_nat (807) in=40b,setxattr P\\lm\\r`\\jpssZmkPqcQSbje_]]`YOSZTeRUUSSY[ (1365) in=40b,setxattr aa^ePena\\opOdeWXTj[XU]N^jQS]bens\\Tc_g]ea (16140) in=40b,setxattr R[qckQQO`n[[egbgcZsdtUbdPdnPNlOmsbP_OXOQ (1227) in=40b,setxattr SpRUpSaQZ]nlQ]kpXZnOWSUS]tsmf`qZiPTkq]Yi (209) in=40b,setxattr Y[Y[X`O_XaVOb]NZ_PgmhRX]Vds_dfbp]h[SPkYb (417) in=40b] snapc 1f=[1f,1e,1c,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-09-17T16:43:25.128 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:04.453973+0000", 2024-09-17T16:43:25.128 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 20.623936500999999, 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016455471999999999, 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 720 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.129 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.453973+0000", 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.453973+0000", 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.453975+0000", 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1399999999999998e-06 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.130 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.454025+0000", 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9617000000000003e-05 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.454037+0000", 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2500000000000001e-05 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.454065+0000", 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7761999999999999e-05 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.131 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.454152+0000", 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6472999999999997e-05 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.454157+0000", 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4940000000000003e-06 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.458505+0000", 2024-09-17T16:43:25.132 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0043474899999999999 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.458654+0000", 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000149569 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.461509+0000", 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028544130000000001 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.133 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.465990+0000", 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0044809990000000003 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.470365+0000", 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0043753239999999999 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:04.470429+0000", 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3690999999999997e-05 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.134 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s4 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:05.470071+0000", 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 19.607839228, 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016847929000000001, 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.135 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.470071+0000", 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.470071+0000", 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.470071+0000", 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.136 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472808+0000", 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027372429999999999 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472818+0000", 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0152999999999999e-05 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.137 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472824+0000", 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5879999999999997e-06 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472878+0000", 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4001e-05 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.138 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.472885+0000", 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.413e-06 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.486877+0000", 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013991686 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:05.486918+0000", 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1734999999999999e-05 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.139 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 96/77 ECSubWrite(tid=368, reqid=osd.4.0:368, at_version=96'63, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.459391+0000", 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.618518715, 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01586193, 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459391+0000", 2024-09-17T16:43:25.140 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459391+0000", 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459392+0000", 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2399999999999998e-07 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.141 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459422+0000", 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0349e-05 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459432+0000", 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0291e-05 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459440+0000", 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1839999999999999e-06 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.142 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459790+0000", 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000349267 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459804+0000", 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3923999999999999e-05 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.475221+0000", 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015417818999999999 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.143 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.475253+0000", 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1572000000000002e-05 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s4 96/34 ECSubWrite(tid=90, reqid=client.4553.0:781, at_version=96'81, trim_to=0'0, roll_forward_to=95'78))", 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.459475+0000", 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.618434352, 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015372171, 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.144 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459475+0000", 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459475+0000", 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.145 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459476+0000", 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7399999999999991e-07 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459500+0000", 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3808999999999999e-05 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459514+0000", 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3396e-05 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.146 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.459528+0000", 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4392999999999999e-05 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.463671+0000", 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041433490000000002 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.147 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.463681+0000", 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7380000000000006e-06 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.474807+0000", 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011125604000000001 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.148 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.474848+0000", 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0908000000000002e-05 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.466373+0000", 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.611536999, 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.033406937999999997, 2024-09-17T16:43:25.149 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466373+0000", 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466373+0000", 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.150 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466374+0000", 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.173e-06 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467224+0000", 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00084987400000000003 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467277+0000", 2024-09-17T16:43:25.151 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3674999999999997e-05 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467290+0000", 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2123000000000001e-05 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467420+0000", 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000130653 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.152 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.467432+0000", 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1603000000000001e-05 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.499713+0000", 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.032281644999999998 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.499780+0000", 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6192000000000006e-05 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.153 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s4 96/77 ECSubWrite(tid=371, reqid=osd.4.0:369, at_version=0'0, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.468847+0000", 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.609063105000001, 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.035317938, 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.154 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468847+0000", 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468847+0000", 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.155 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468848+0000", 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0899999999999999e-06 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468860+0000", 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2608e-05 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.156 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468878+0000", 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7363e-05 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468887+0000", 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.833e-06 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.157 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469498+0000", 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00061144499999999996 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469508+0000", 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0473e-05 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.158 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504081+0000", 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.034572229000000003 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504165+0000", 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3897e-05 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.159 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.160 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.160 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:25.160 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.470770+0000", 2024-09-17T16:43:25.160 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.607140207, 2024-09-17T16:43:25.160 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.031491237999999998, 2024-09-17T16:43:25.160 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470770+0000", 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470770+0000", 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.161 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470770+0000", 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.32e-07 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471237+0000", 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000466985 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471254+0000", 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6653000000000001e-05 2024-09-17T16:43:25.162 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.471263+0000", 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0720000000000006e-06 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.476722+0000", 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0054595850000000003 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.163 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.476732+0000", 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9680000000000001e-06 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502201+0000", 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025468607000000001 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502261+0000", 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9935999999999997e-05 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.164 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.479306+0000", 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.598603563999999, 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.023327807999999998, 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.165 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479306+0000", 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479306+0000", 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479307+0000", 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5799999999999998e-07 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.166 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479539+0000", 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00023159499999999999 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479549+0000", 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0427e-05 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479557+0000", 2024-09-17T16:43:25.167 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8420000000000005e-06 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494558+0000", 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015001482 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.168 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494567+0000", 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4910000000000005e-06 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502467+0000", 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079000839999999999 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.169 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502634+0000", 2024-09-17T16:43:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016712899999999999 2024-09-17T16:43:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.170 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s4 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.479588+0000", 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.598322185000001, 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.025592782000000001, 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.171 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.172 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.172 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.172 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.172 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.172 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479588+0000", 2024-09-17T16:43:25.172 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479588+0000", 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.173 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.174 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.174 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.479588+0000", 2024-09-17T16:43:25.174 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6100000000000001e-07 2024-09-17T16:43:25.174 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.174 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.175 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481079+0000", 2024-09-17T16:43:25.175 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014912829999999999 2024-09-17T16:43:25.175 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.175 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.175 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481095+0000", 2024-09-17T16:43:25.176 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6067e-05 2024-09-17T16:43:25.176 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.176 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.176 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.176 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481104+0000", 2024-09-17T16:43:25.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3729999999999993e-06 2024-09-17T16:43:25.177 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.177 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.177 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.177 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.486477+0000", 2024-09-17T16:43:25.177 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0053735190000000002 2024-09-17T16:43:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.486487+0000", 2024-09-17T16:43:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0200999999999999e-05 2024-09-17T16:43:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.179 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.179 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.505145+0000", 2024-09-17T16:43:25.179 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018657462999999999 2024-09-17T16:43:25.179 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.179 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.180 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.180 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.505180+0000", 2024-09-17T16:43:25.180 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5414999999999999e-05 2024-09-17T16:43:25.180 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.180 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.180 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.181 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.181 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.181 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s6 96/34 ECSubWrite(tid=83, reqid=client.4553.0:800, at_version=96'43, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:25.181 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.488084+0000", 2024-09-17T16:43:25.181 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.589825543, 2024-09-17T16:43:25.181 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016254300999999999, 2024-09-17T16:43:25.182 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.182 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.182 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.182 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.182 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.182 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488084+0000", 2024-09-17T16:43:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488084+0000", 2024-09-17T16:43:25.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.184 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.184 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.184 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.184 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488085+0000", 2024-09-17T16:43:25.184 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1030000000000001e-06 2024-09-17T16:43:25.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.185 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.185 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.185 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488230+0000", 2024-09-17T16:43:25.185 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00014512800000000001 2024-09-17T16:43:25.185 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488249+0000", 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8505e-05 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.186 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488258+0000", 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0399999999999998e-06 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488319+0000", 2024-09-17T16:43:25.187 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0665999999999998e-05 2024-09-17T16:43:25.188 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.188 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.188 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.188 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488328+0000", 2024-09-17T16:43:25.188 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7249999999999992e-06 2024-09-17T16:43:25.188 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504306+0000", 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015977409000000001 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504338+0000", 2024-09-17T16:43:25.189 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2725000000000003e-05 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s3 96/77 ECSubWrite(tid=378, reqid=client.4553.0:796, at_version=96'67, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.488490+0000", 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 15.589419241, 2024-09-17T16:43:25.190 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014104787000000001, 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488490+0000", 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488490+0000", 2024-09-17T16:43:25.191 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488491+0000", 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.3900000000000001e-07 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488543+0000", 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2469000000000002e-05 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.192 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488551+0000", 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0600000000000008e-06 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488558+0000", 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3820000000000001e-06 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.193 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.499812+0000", 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011254019000000001 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.499821+0000", 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5610000000000004e-06 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.194 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502574+0000", 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0027529989999999999 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.502595+0000", 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1058000000000001e-05 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.195 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.bs2 101/34 ECSubWrite(tid=424, reqid=client.4553.0:869, at_version=101'140, trim_to=0'0, roll_forward_to=100'138))", 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:14.492971+0000", 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 10.584938588, 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014827355, 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.196 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.492971+0000", 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.492971+0000", 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.197 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.492973+0000", 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3969999999999999e-06 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495377+0000", 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0024040429999999998 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495393+0000", 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6367000000000001e-05 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.198 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495402+0000", 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3540000000000006e-06 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495483+0000", 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1132999999999997e-05 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.199 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.495496+0000", 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2309e-05 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.507771+0000", 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012275484999999999 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.200 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:14.507799+0000", 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.7267000000000002e-05 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.7s4 111/107 ECSubWrite(tid=511, reqid=client.4553.0:925, at_version=111'140, trim_to=0'0, roll_forward_to=110'138))", 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:24.470219+0000", 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 0.60769114999999996, 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015605443, 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.201 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.470219+0000", 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.470219+0000", 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.202 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.470219+0000", 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6000000000000003e-07 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.470976+0000", 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00075680599999999995 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.470997+0000", 2024-09-17T16:43:25.203 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0832e-05 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.471006+0000", 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0399999999999998e-06 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.471076+0000", 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0355e-05 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.204 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.471087+0000", 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0599e-05 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.485799+0000", 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014712246 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:24.485824+0000", 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4805000000000001e-05 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.205 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.206 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.206 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.206 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:25.207 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:43:25.208 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:25.205+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:25.308 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:25.305+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:25.310 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:25.310 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:25.310 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:25.310 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:25.319 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:43:25.409 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:25.407+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:25.420 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:25.420 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:25.420 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:25.420 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:25.421 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:25.429 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:43:25.457 INFO:tasks.rados.rados.0.smithi183.stdout:374: done (5 left) 2024-09-17T16:43:25.457 INFO:tasks.rados.rados.0.smithi183.stdout:375: done (4 left) 2024-09-17T16:43:25.458 INFO:tasks.rados.rados.0.smithi183.stdout:376: done (3 left) 2024-09-17T16:43:25.458 INFO:tasks.rados.rados.0.smithi183.stdout:377: done (2 left) 2024-09-17T16:43:25.458 INFO:tasks.rados.rados.0.smithi183.stdout:378: done (1 left) 2024-09-17T16:43:25.458 INFO:tasks.rados.rados.0.smithi183.stdout:379: done (0 left) 2024-09-17T16:43:25.458 INFO:tasks.rados.rados.0.smithi183.stdout:380: copy_from oid 10 from oid 14 current snap is 38 2024-09-17T16:43:25.458 INFO:tasks.rados.rados.0.smithi183.stdout:381: snap_remove snap 36 2024-09-17T16:43:25.484 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:43:25.528 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:25.525+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:25.565 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:25.565 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:25.565 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:270 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~655360] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 66.042046803000005, 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013861503000000001, 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.566 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 270 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.567 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520436+0000", 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520438+0000", 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0849999999999999e-06 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.568 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520784+0000", 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00034672700000000002 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520799+0000", 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4945e-05 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.569 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520809+0000", 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999997e-06 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.520888+0000", 2024-09-17T16:43:25.570 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9523000000000004e-05 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.521021+0000", 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00013319300000000001 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522568+0000", 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0015468770000000001 2024-09-17T16:43:25.571 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531077+0000", 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085082820000000007 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534240+0000", 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031634889999999998 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.572 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534297+0000", 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7151999999999998e-05 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:271 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:43:25.573 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 66.039651676999995, 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01199191, 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 271 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.574 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.575 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522831+0000", 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.522833+0000", 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.889e-06 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523129+0000", 2024-09-17T16:43:25.576 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00029651599999999998 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523150+0000", 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0537e-05 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523159+0000", 2024-09-17T16:43:25.577 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2329999999999995e-06 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527318+0000", 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041587719999999998 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527398+0000", 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0752000000000002e-05 2024-09-17T16:43:25.578 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.527918+0000", 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00051932300000000003 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.579 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531167+0000", 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032495649999999998 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534786+0000", 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036188050000000001 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.580 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534823+0000", 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6517999999999998e-05 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:272 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc 6=[6] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 66.039303254999993, 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011828584, 2024-09-17T16:43:25.581 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 272 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:43:25.582 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523179+0000", 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523180+0000", 2024-09-17T16:43:25.583 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0800000000000004e-07 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523184+0000", 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1989999999999999e-06 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.584 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523202+0000", 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7932999999999999e-05 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523210+0000", 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.5050000000000001e-06 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.585 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530456+0000", 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072466300000000004 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530520+0000", 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3615999999999995e-05 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.586 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.530847+0000", 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032758 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531332+0000", 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00048465900000000002 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.587 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.534949+0000", 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0036167159999999999 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535008+0000", 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.9038e-05 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.588 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:273 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e46)", 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 66.039260403, 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012586701, 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.589 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 273 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523222+0000", 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.590 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523223+0000", 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0299999999999999e-07 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523226+0000", 2024-09-17T16:43:25.591 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.2150000000000001e-06 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523234+0000", 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9100000000000005e-06 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.523241+0000", 2024-09-17T16:43:25.592 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1899999999999998e-06 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531097+0000", 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078564370000000008 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.531159+0000", 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.1278000000000005e-05 2024-09-17T16:43:25.593 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535259+0000", 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041002670000000003 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535355+0000", 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5707999999999999e-05 2024-09-17T16:43:25.594 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:19.535809+0000", 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00045409299999999998 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:297 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~737280] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:43:25.595 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 62.080492378999999, 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011819003, 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 297 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.596 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481990+0000", 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.597 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.481992+0000", 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.001e-06 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482367+0000", 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00037461699999999999 2024-09-17T16:43:25.598 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482382+0000", 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5693e-05 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482389+0000", 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.08e-06 2024-09-17T16:43:25.599 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482440+0000", 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0917000000000001e-05 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.482445+0000", 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6410000000000001e-06 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.600 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484030+0000", 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001585328 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484091+0000", 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.0677999999999997e-05 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.601 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.485118+0000", 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010273400000000001 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493041+0000", 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079222289999999994 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493728+0000", 2024-09-17T16:43:25.602 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00068753100000000001 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493809+0000", 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0947999999999998e-05 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:298 3.3s0 3:c04ffb2b:::smithi18337221-3:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 62.078128434999996, 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011840491999999999, 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.604 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 298 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.605 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484354+0000", 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484355+0000", 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0249999999999999e-06 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484537+0000", 2024-09-17T16:43:25.606 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018172699999999999 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484548+0000", 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1202999999999999e-05 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484555+0000", 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4839999999999998e-06 2024-09-17T16:43:25.607 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489700+0000", 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0051447760000000002 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.489765+0000", 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4311000000000001e-05 2024-09-17T16:43:25.608 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.490228+0000", 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046323600000000001 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493079+0000", 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0028515580000000001 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.609 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496152+0000", 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0030726970000000001 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496195+0000", 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.2475000000000002e-05 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.610 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:299 3.3s0 3:c04ffb2b:::smithi18337221-3:head [setxattr _header (55) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 62.077910170000003, 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01186708, 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.611 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 299 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.612 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484572+0000", 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484573+0000", 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2399999999999998e-07 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484576+0000", 2024-09-17T16:43:25.613 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4920000000000002e-06 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484582+0000", 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.096e-06 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484587+0000", 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2390000000000002e-06 2024-09-17T16:43:25.614 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492444+0000", 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078571289999999992 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492500+0000", 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5806000000000001e-05 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.615 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492763+0000", 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00026361899999999998 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.493177+0000", 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041339600000000001 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.616 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496387+0000", 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0032098970000000002 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496439+0000", 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2781999999999997e-05 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.617 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:300 3.3s0 3:c04ffb2b:::smithi18337221-3:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 62.077887136999998, 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012900164, 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:25.618 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 300 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.619 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484595+0000", 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484596+0000", 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.63e-07 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.620 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484599+0000", 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.1690000000000001e-06 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484607+0000", 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7789999999999996e-06 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.621 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.484612+0000", 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.1379999999999998e-06 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492930+0000", 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083180240000000003 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:25.622 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.492979+0000", 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9021999999999999e-05 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496702+0000", 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037230459999999998 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.623 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.496783+0000", 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1225999999999998e-05 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:23.497495+0000", 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00071229699999999997 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.624 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=45, reqid=osd.0.0:45, at_version=60'39, trim_to=0'0, roll_forward_to=59'37))", 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 52.050617981000002, 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094427290000000004, 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.625 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511864+0000", 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.626 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511865+0000", 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4000000000000001e-07 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511882+0000", 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6923e-05 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.627 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511889+0000", 2024-09-17T16:43:25.628 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9609999999999999e-06 2024-09-17T16:43:25.628 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.628 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.628 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511895+0000", 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8889999999999996e-06 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511967+0000", 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1373999999999998e-05 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.629 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.511978+0000", 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1080999999999999e-05 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521259+0000", 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092809539999999992 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.630 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.521307+0000", 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8406999999999999e-05 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 60/34 ECSubWrite(tid=48, reqid=client.4553.0:454, at_version=60'42, trim_to=0'0, roll_forward_to=60'41))", 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:43:25.631 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 51.972553345999998, 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010035229, 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.632 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589929+0000", 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.589930+0000", 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.105e-06 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.633 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590524+0000", 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059383899999999998 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590544+0000", 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0292000000000002e-05 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.634 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590555+0000", 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0344e-05 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590629+0000", 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4610000000000006e-05 2024-09-17T16:43:25.635 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.590640+0000", 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0969e-05 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599920+0000", 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0092792629999999994 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.636 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.599964+0000", 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4807e-05 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.6s2 76/34 ECSubWrite(tid=62, reqid=client.4553.0:602, at_version=76'57, trim_to=0'0, roll_forward_to=63'55))", 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 36.086008929000002, 2024-09-17T16:43:25.637 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010964612, 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.638 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476474+0000", 2024-09-17T16:43:25.639 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9399999999999999e-07 2024-09-17T16:43:25.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.640 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.640 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.640 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476883+0000", 2024-09-17T16:43:25.640 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000408978 2024-09-17T16:43:25.640 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476900+0000", 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6883000000000001e-05 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.641 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476910+0000", 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0842999999999999e-05 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.476992+0000", 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.161e-05 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.642 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.477005+0000", 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2581e-05 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487394+0000", 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.01038942 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.643 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:49.487438+0000", 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4103000000000001e-05 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s1 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.468673+0000", 2024-09-17T16:43:25.644 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.093809824000001, 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014098372, 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468673+0000", 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.645 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468673+0000", 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.468673+0000", 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.7000000000000005e-07 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.646 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469097+0000", 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042371900000000003 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469115+0000", 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8182999999999999e-05 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.647 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469124+0000", 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5580000000000001e-06 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469230+0000", 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00010664 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.648 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.469240+0000", 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4269999999999997e-06 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.482716+0000", 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013476115 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.649 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.482771+0000", 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.516e-05 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s1 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.472253+0000", 2024-09-17T16:43:25.650 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.090229511, 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.024357409, 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472253+0000", 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.651 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472253+0000", 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472254+0000", 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9999999999999995e-07 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.652 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472491+0000", 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00023675000000000001 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472505+0000", 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3977e-05 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472520+0000", 2024-09-17T16:43:25.653 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5511000000000001e-05 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.477123+0000", 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0046031650000000002 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.477132+0000", 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.5450000000000003e-06 2024-09-17T16:43:25.654 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496576+0000", 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019443740000000001 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496610+0000", 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4721000000000002e-05 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.655 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s1 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.477979+0000", 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.084503907999999, 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018657524000000002, 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.656 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.477979+0000", 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.477979+0000", 2024-09-17T16:43:25.657 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.477979+0000", 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0399999999999995e-07 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478154+0000", 2024-09-17T16:43:25.658 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000175136 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478168+0000", 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3703000000000001e-05 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478176+0000", 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.9680000000000006e-06 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.659 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.482809+0000", 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.004633051 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.482819+0000", 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7720000000000006e-06 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.660 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496616+0000", 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013797174000000001 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496636+0000", 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0015999999999999e-05 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.661 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s4 96/34 ECSubWrite(tid=82, reqid=client.4553.0:799, at_version=96'42, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.480745+0000", 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.081737374999999, 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010537171999999999, 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.662 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480745+0000", 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480745+0000", 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480745+0000", 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5400000000000002e-07 2024-09-17T16:43:25.663 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481575+0000", 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082976600000000001 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481592+0000", 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7283e-05 2024-09-17T16:43:25.664 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481601+0000", 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3559999999999993e-06 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481666+0000", 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4752000000000006e-05 2024-09-17T16:43:25.665 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481675+0000", 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6970000000000005e-06 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.491241+0000", 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0095657559999999999 2024-09-17T16:43:25.666 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.491282+0000", 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1208000000000003e-05 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.667 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s1 96/77 ECSubWrite(tid=378, reqid=client.4553.0:796, at_version=96'67, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.487107+0000", 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.075375113, 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0095643970000000005, 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.668 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487107+0000", 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487107+0000", 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487108+0000", 2024-09-17T16:43:25.669 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6700000000000002e-07 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487158+0000", 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.9744999999999999e-05 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.670 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487171+0000", 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.3292000000000001e-05 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487179+0000", 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.2209999999999997e-06 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.492476+0000", 2024-09-17T16:43:25.671 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052968640000000001 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.492487+0000", 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0895e-05 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.672 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496654+0000", 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041672569999999997 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496672+0000", 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7255999999999999e-05 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.673 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s4 96/34 ECSubWrite(tid=83, reqid=client.4553.0:800, at_version=96'43, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.487774+0000", 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.074708755, 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.020336511000000002, 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487774+0000", 2024-09-17T16:43:25.674 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487774+0000", 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487774+0000", 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.8199999999999999e-07 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.675 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.493021+0000", 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0052465239999999998 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.493033+0000", 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.253e-05 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.676 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.493042+0000", 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3969999999999994e-06 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.493096+0000", 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.3841999999999997e-05 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.493105+0000", 2024-09-17T16:43:25.677 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1759999999999999e-06 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.508089+0000", 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014984466 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.678 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.508110+0000", 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0894e-05 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s4 96/34 ECSubWrite(tid=84, reqid=client.4553.0:801, at_version=96'44, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.495882+0000", 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 16.066600733000001, 2024-09-17T16:43:25.679 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012246541999999999, 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495882+0000", 2024-09-17T16:43:25.680 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495882+0000", 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495882+0000", 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.3900000000000004e-07 2024-09-17T16:43:25.681 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496296+0000", 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00041380300000000002 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496311+0000", 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4697e-05 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.682 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496319+0000", 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4330000000000004e-06 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.500839+0000", 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0045191299999999997 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.683 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.500849+0000", 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0217000000000001e-05 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.508116+0000", 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0072670790000000001 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.684 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.508128+0000", 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2444e-05 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:904 3.3s0 3:c04ffb2b:::smithi18337221-3:head [copy-from ver 12] snapc 24=[23,1e] ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:20.455313+0000", 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.1071697719999998, 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.02755237, 2024-09-17T16:43:25.685 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 904 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.686 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455313+0000", 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455313+0000", 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.687 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455315+0000", 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.4030000000000001e-06 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455324+0000", 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.1290000000000002e-06 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.688 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455346+0000", 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.1421e-05 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455356+0000", 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0705e-05 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.689 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455615+0000", 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00025866499999999999 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "op must wait for map", 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455625+0000", 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.9510000000000001e-06 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.461877+0000", 2024-09-17T16:43:25.690 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0062521160000000003 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.462004+0000", 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00012734899999999999 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.476978+0000", 2024-09-17T16:43:25.691 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.014973715 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.480682+0000", 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0037035850000000001 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "commit_sent", 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.482812+0000", 2024-09-17T16:43:25.692 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.002130463 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.482865+0000", 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2868000000000003e-05 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.693 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "osd_op(client.4553.0:905 3.3s0 3:c04ffb2b:::smithi18337221-3:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e107)", 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:20.455411+0000", 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 5.1070716789999997, 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0251992940000001, 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "started", 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "client_info": { 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "client": "client.4553", 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "tid": 905 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:25.694 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455411+0000", 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455411+0000", 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.695 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455412+0000", 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1699999999999997e-07 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455415+0000", 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.3210000000000001e-06 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.696 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455424+0000", 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8589999999999994e-06 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455433+0000", 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5480000000000007e-06 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.697 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455696+0000", 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000262525 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.455706+0000", 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8910000000000007e-06 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.462200+0000", 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0064947399999999997 2024-09-17T16:43:25.698 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:20.462251+0000", 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.0958000000000002e-05 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.480380+0000", 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0181290110000001 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "started", 2024-09-17T16:43:25.699 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.480493+0000", 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000112864 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:21.480610+0000", 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00011686 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.700 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:25.701 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:25.701 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:25.702 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:25.699+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:25.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T16:43:25.803 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:25.800+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:25.811 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:25.811 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:25.811 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:25.812 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:25.820 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T16:43:25.904 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:25.902+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:25.967 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:25.967 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:25.967 INFO:teuthology.orchestra.run.smithi060.stdout: "complaint_time": 30, 2024-09-17T16:43:25.967 INFO:teuthology.orchestra.run.smithi060.stdout: "num_blocked_ops": 0 2024-09-17T16:43:25.967 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:25.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T16:43:26.005 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:26.003+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:26.084 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-17T16:43:26.084 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:209 3.6s0 3:6d4c68b4:::smithi18337221-35:head [copy-from ver 2] snapc 3=[2] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.590797756000001, 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019587552000000001, 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.085 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 209 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490468+0000", 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490471+0000", 2024-09-17T16:43:26.087 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.492e-06 2024-09-17T16:43:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490480+0000", 2024-09-17T16:43:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6810000000000004e-06 2024-09-17T16:43:26.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490502+0000", 2024-09-17T16:43:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.2005e-05 2024-09-17T16:43:26.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490512+0000", 2024-09-17T16:43:26.090 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0129000000000001e-05 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490586+0000", 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4232000000000003e-05 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490679+0000", 2024-09-17T16:43:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.2909000000000001e-05 2024-09-17T16:43:26.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.497687+0000", 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070084520000000001 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.093 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.506016+0000", 2024-09-17T16:43:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0083282830000000006 2024-09-17T16:43:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.094 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.509967+0000", 2024-09-17T16:43:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039514509999999999 2024-09-17T16:43:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.510056+0000", 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.8918000000000005e-05 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.096 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 40/34 ECSubWrite(tid=12, reqid=client.4553.0:205, at_version=40'9, trim_to=0'0, roll_forward_to=39'7))", 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 72.590631981000001, 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018101223999999999, 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.097 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490634+0000", 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.490635+0000", 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0699999999999997e-07 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.098 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492045+0000", 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001410644 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492086+0000", 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0726999999999998e-05 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492098+0000", 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2163e-05 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.099 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492226+0000", 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012778900000000001 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.492241+0000", 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4932e-05 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508691+0000", 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016449693000000001 2024-09-17T16:43:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:13.508735+0000", 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.4768999999999998e-05 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:372 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~507904] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.568572152999998, 2024-09-17T16:43:26.101 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017260719000000001, 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 372 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:26.102 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512694+0000", 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.512696+0000", 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8700000000000001e-06 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513289+0000", 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00059281000000000004 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513305+0000", 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6494000000000002e-05 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513312+0000", 2024-09-17T16:43:26.104 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5889999999999999e-06 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513379+0000", 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6659e-05 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.513491+0000", 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011233199999999999 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.105 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.514868+0000", 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001377407 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.525432+0000", 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010563863 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529881+0000", 2024-09-17T16:43:26.106 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0044490329999999998 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529955+0000", 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.3662e-05 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:376 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:26.107 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.562814701000001, 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015816857, 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 376 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.108 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518452+0000", 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.06e-07 2024-09-17T16:43:26.109 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518456+0000", 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6679999999999999e-06 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518474+0000", 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.8652e-05 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.518481+0000", 2024-09-17T16:43:26.110 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.2920000000000001e-06 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529124+0000", 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010643556 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.529173+0000", 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8321e-05 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.111 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533229+0000", 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0040568990000000001 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.533274+0000", 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5016999999999999e-05 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.112 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.534268+0000", 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00099394599999999989 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:398 3.6s0 3:6f1c8401:::smithi18337221-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 57.470993538000002, 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015904456000000001, 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.113 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 398 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.114 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610273+0000", 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4400000000000001e-07 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610275+0000", 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0490000000000002e-06 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.115 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610279+0000", 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.7570000000000002e-06 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.610282+0000", 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.4139999999999998e-06 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621112+0000", 2024-09-17T16:43:26.116 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010829319 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.621164+0000", 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2238999999999999e-05 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625667+0000", 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0045036399999999997 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.117 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.625718+0000", 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.0970000000000002e-05 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:28.626177+0000", 2024-09-17T16:43:26.118 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00045872399999999998 2024-09-17T16:43:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.119 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:602 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~557056] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.609338458000003, 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020848021000000001, 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.120 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 602 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.121 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471928+0000", 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.471930+0000", 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4210000000000002e-06 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472516+0000", 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00058545400000000001 2024-09-17T16:43:26.122 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472540+0000", 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.4527000000000001e-05 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472550+0000", 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5920000000000007e-06 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472637+0000", 2024-09-17T16:43:26.123 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7214999999999998e-05 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "op must wait for map", 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.472648+0000", 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1401e-05 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.474838+0000", 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0021897409999999998 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.124 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.474925+0000", 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6918999999999999e-05 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476046+0000", 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0011207319999999999 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492584+0000", 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016537854000000001 2024-09-17T16:43:26.125 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492709+0000", 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012510599999999999 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492776+0000", 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.7058999999999996e-05 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.126 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:603 3.6s0 3:6d4c68b4:::smithi18337221-35:head [append 0~638976] snapc 18=[18,17,16,15,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.605977080000002, 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017813141000000001, 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 603 2024-09-17T16:43:26.127 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475289+0000", 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.128 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.475290+0000", 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.209e-06 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476082+0000", 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00079194400000000005 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476100+0000", 2024-09-17T16:43:26.129 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.7829000000000002e-05 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.476107+0000", 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.8059999999999997e-06 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480053+0000", 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0039456170000000002 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.130 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480139+0000", 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6389000000000002e-05 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480834+0000", 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00069457000000000004 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.492585+0000", 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01175114 2024-09-17T16:43:26.131 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493048+0000", 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00046288200000000002 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.493102+0000", 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4755e-05 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.132 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:606 3.6s0 3:6d4c68b4:::smithi18337221-35:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 36.601180642000003, 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017083732000000001, 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 606 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.133 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.134 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480086+0000", 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.8999999999999998e-07 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480087+0000", 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4339999999999999e-06 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480091+0000", 2024-09-17T16:43:26.135 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.9360000000000001e-06 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.480094+0000", 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9900000000000002e-06 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494631+0000", 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014536445 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.136 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.494697+0000", 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5832000000000003e-05 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.496058+0000", 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.001361623 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.496104+0000", 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.5401999999999997e-05 2024-09-17T16:43:26.137 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:49.497169+0000", 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0010657799999999999 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:631 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~3850240,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.635028047999999, 2024-09-17T16:43:26.138 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016155756, 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 631 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.139 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446238+0000", 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446239+0000", 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.6700000000000003e-07 2024-09-17T16:43:26.140 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446242+0000", 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.5200000000000002e-06 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446247+0000", 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.164e-06 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.141 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446251+0000", 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.6660000000000001e-06 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446397+0000", 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00014552 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446403+0000", 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.5440000000000004e-06 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.142 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.449745+0000", 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0033422790000000001 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.449869+0000", 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00012339100000000001 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462394+0000", 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.012525105 2024-09-17T16:43:26.143 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:632 3.6s0 3:636772f7:::smithi18337221-13:head [read 0~3850240,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.634988658000001, 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020060099000000001, 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "started", 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.144 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 632 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:26.145 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.196 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.196 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.196 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:26.196 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.196 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.197 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.197 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446278+0000", 2024-09-17T16:43:26.197 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.1e-07 2024-09-17T16:43:26.197 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.197 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.198 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446281+0000", 2024-09-17T16:43:26.198 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.309e-06 2024-09-17T16:43:26.198 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.198 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.198 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446292+0000", 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0852999999999999e-05 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446301+0000", 2024-09-17T16:43:26.199 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.6000000000000007e-06 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446432+0000", 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013141800000000001 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.446442+0000", 2024-09-17T16:43:26.200 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8099999999999992e-06 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.451647+0000", 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052050009999999999 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.451706+0000", 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.9515999999999997e-05 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.201 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.466338+0000", 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.014631282000000001 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.618725232999999, 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017904584000000001, 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.202 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462541+0000", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462542+0000", 2024-09-17T16:43:26.203 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.7400000000000003e-07 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462693+0000", 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015141899999999999 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462706+0000", 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2813000000000001e-05 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.204 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462714+0000", 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2609999999999993e-06 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462976+0000", 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00026219399999999999 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462986+0000", 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.5259999999999999e-06 2024-09-17T16:43:26.205 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480397+0000", 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017411357999999998 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480446+0000", 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8439000000000002e-05 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.cs2 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 30.61852807, 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.017745053, 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.207 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462738+0000", 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462739+0000", 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.2900000000000004e-07 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462963+0000", 2024-09-17T16:43:26.208 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00022424899999999999 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462976+0000", 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2843999999999999e-05 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.462984+0000", 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.2320000000000001e-06 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.209 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.469986+0000", 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0070019690000000002 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.469993+0000", 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4309999999999997e-06 2024-09-17T16:43:26.210 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.211 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.211 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480453+0000", 2024-09-17T16:43:26.211 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.010459163 2024-09-17T16:43:26.211 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.211 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:55.480483+0000", 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 3.0636000000000003e-05 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.212 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.bs1 85/34 ECSubWrite(tid=305, reqid=client.4553.0:683, at_version=85'114, trim_to=0'0, roll_forward_to=85'113))", 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 27.557155392999999, 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018433593000000002, 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:26.213 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524111+0000", 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.4899999999999995e-07 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.214 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524216+0000", 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00010487100000000001 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524228+0000", 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.169e-05 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524235+0000", 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0790000000000003e-06 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.215 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524306+0000", 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0479000000000001e-05 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.524317+0000", 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1772e-05 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.542459+0000", 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018142121000000001 2024-09-17T16:43:26.216 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:42:58.542544+0000", 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5031999999999995e-05 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.8s1 92/34 ECSubWrite(tid=61, reqid=osd.11.0:60, at_version=0'0, trim_to=0'0, roll_forward_to=92'46))", 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.630020588000001, 2024-09-17T16:43:26.217 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021134724000000001, 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.218 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.219 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:26.219 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.219 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.219 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.219 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451246+0000", 2024-09-17T16:43:26.220 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.5600000000000005e-07 2024-09-17T16:43:26.220 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.220 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.220 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.220 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451258+0000", 2024-09-17T16:43:26.221 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1219999999999999e-05 2024-09-17T16:43:26.221 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.221 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.221 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.221 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451270+0000", 2024-09-17T16:43:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2377e-05 2024-09-17T16:43:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.451280+0000", 2024-09-17T16:43:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.8039999999999996e-06 2024-09-17T16:43:26.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.223 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.223 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.223 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.452018+0000", 2024-09-17T16:43:26.223 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00073787500000000003 2024-09-17T16:43:26.223 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.224 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.224 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.224 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.452028+0000", 2024-09-17T16:43:26.224 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0539e-05 2024-09-17T16:43:26.224 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.472336+0000", 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.020308263999999999 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.472380+0000", 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.3888999999999999e-05 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.225 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.7s3 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:05.470236+0000", 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 20.611029918, 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019215115000000001, 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.226 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470236+0000", 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470236+0000", 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470237+0000", 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.67e-07 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.227 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470613+0000", 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00037657899999999999 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470629+0000", 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.6308e-05 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470640+0000", 2024-09-17T16:43:26.228 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0753e-05 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470728+0000", 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.7577000000000005e-05 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.470740+0000", 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.2364000000000001e-05 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.229 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489424+0000", 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.018683669 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:05.489451+0000", 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.7597999999999999e-05 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:781 3.6s0 3:636772f7:::smithi18337221-13:head [rollback 1a] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:26.230 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.627440518, 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021405731000000001, 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 781 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.231 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.232 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:26.232 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.232 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.232 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:26.233 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.233 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.233 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453826+0000", 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5799999999999999e-07 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453834+0000", 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.2230000000000001e-06 2024-09-17T16:43:26.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453842+0000", 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0450000000000001e-06 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453847+0000", 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.5860000000000004e-06 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.235 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453984+0000", 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00013731400000000001 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453992+0000", 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.0559999999999999e-06 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.458168+0000", 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.004176903 2024-09-17T16:43:26.236 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.458262+0000", 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3350999999999994e-05 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.237 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.238 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.458809+0000", 2024-09-17T16:43:26.238 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00054745900000000003 2024-09-17T16:43:26.238 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.238 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.238 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.465523+0000", 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0067142749999999996 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475142+0000", 2024-09-17T16:43:26.239 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0096188179999999995 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475231+0000", 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.9142999999999997e-05 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.240 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:782 3.6s0 3:636772f7:::smithi18337221-13:head [append 0~0] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.627409396000001, 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.021585318999999999, 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 782 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.241 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453857+0000", 2024-09-17T16:43:26.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.8100000000000003e-07 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453860+0000", 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.6759999999999999e-06 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453867+0000", 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 6.6669999999999999e-06 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.453874+0000", 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.4529999999999996e-06 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454027+0000", 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00015268899999999999 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.454034+0000", 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 7.1319999999999996e-06 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.459979+0000", 2024-09-17T16:43:26.245 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059451900000000004 2024-09-17T16:43:26.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.460085+0000", 2024-09-17T16:43:26.246 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000105989 2024-09-17T16:43:26.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.460614+0000", 2024-09-17T16:43:26.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00052899700000000002 2024-09-17T16:43:26.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.465525+0000", 2024-09-17T16:43:26.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0049110719999999998 2024-09-17T16:43:26.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.248 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.248 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.248 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475361+0000", 2024-09-17T16:43:26.248 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0098354810000000001 2024-09-17T16:43:26.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.475442+0000", 2024-09-17T16:43:26.249 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.1491999999999998e-05 2024-09-17T16:43:26.249 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "osd_op(client.4553.0:792 3.6s0 3:6f1c8401:::smithi18337221-16:head [rmxattr OliOVUW in=7b,rmxattr QSnNfhP`\\rbs^]tkaRf]mXj_]bm_arNTstOQjkpY in=40b,rmxattr SXYNfcNts[adfhlcih^SbYXacRgpdjjt_UedQoso in=40b,rmxattr Y`URWapPpbRbcVnVY`QSNsZaZVYgbfr]kcmrp_g\\ in=40b,rmxattr b\\PtoYR`hmWtnd_a[S\\\\lXhWq]eThtkqjphngsWR in=40b,rmxattr cbOj`RWijYOTWkn\\Sk\\N_a[otcWhlc_kPXhaQhtm in=40b,rmxattr gac_OaSTa[cilYpd\\TYRomd[_[t]lkbeSfUstbbO in=40b,rmxattr iYtRdsiUT^YaZcYqmPkOTbnaa_c^ in=28b,rmxattr mRZhPnOqZXai[tb[_iYpr_fWU`VpVZePspesWXth in=40b,rmxattr rX`YVl[kmaRi[QfikjQasTjWZSRiWrW`bkcandUf in=40b] snapc 21=[21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-17T16:43:26.250 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.457790+0000", 2024-09-17T16:43:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.623476400000001, 2024-09-17T16:43:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.019071910000000001, 2024-09-17T16:43:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: "client_info": { 2024-09-17T16:43:26.252 INFO:teuthology.orchestra.run.smithi060.stdout: "client": "client.4553", 2024-09-17T16:43:26.252 INFO:teuthology.orchestra.run.smithi060.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:26.252 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 792 2024-09-17T16:43:26.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.252 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.253 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.253 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457790+0000", 2024-09-17T16:43:26.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457790+0000", 2024-09-17T16:43:26.254 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457792+0000", 2024-09-17T16:43:26.255 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.0679999999999999e-06 2024-09-17T16:43:26.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457800+0000", 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.0819999999999999e-06 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457813+0000", 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.313e-05 2024-09-17T16:43:26.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.457822+0000", 2024-09-17T16:43:26.257 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.4360000000000002e-06 2024-09-17T16:43:26.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461035+0000", 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0032138929999999998 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "started", 2024-09-17T16:43:26.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.461151+0000", 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00011519300000000001 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.462027+0000", 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00087607199999999998 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.466346+0000", 2024-09-17T16:43:26.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0043196839999999999 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "commit_sent", 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476741+0000", 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.01039495 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.476862+0000", 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.000120402 2024-09-17T16:43:26.260 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.7s3 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 16.602284672, 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016005958000000001, 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.261 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.478982+0000", 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.0599999999999999e-07 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479302+0000", 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00031962199999999998 2024-09-17T16:43:26.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479318+0000", 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.5832e-05 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479327+0000", 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.264 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479421+0000", 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 9.3516000000000004e-05 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.479434+0000", 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.3573e-05 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494947+0000", 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015512685 2024-09-17T16:43:26.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:09.494988+0000", 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 4.0363e-05 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "MOSDECSubOpWrite(3.7s3 111/107 ECSubWrite(tid=511, reqid=client.4553.0:925, at_version=111'140, trim_to=0'0, roll_forward_to=110'138))", 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-17T16:43:24.469317+0000", 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 1.6119489890000001, 2024-09-17T16:43:26.266 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.016197122000000001, 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "reached pg", 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated", 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469317+0000", 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read", 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469317+0000", 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0 2024-09-17T16:43:26.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled", 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469319+0000", 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.389e-06 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read", 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469654+0000", 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.00033538600000000002 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched", 2024-09-17T16:43:26.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469678+0000", 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.385e-05 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "queued_for_pg", 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469690+0000", 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.1878999999999999e-05 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "reached_pg", 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469775+0000", 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 8.5523000000000001e-05 2024-09-17T16:43:26.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_started", 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.469790+0000", 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.4489e-05 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "sub_op_committed", 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.485484+0000", 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.015694718 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done", 2024-09-17T16:43:26.270 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-17T16:43:24.485514+0000", 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 2.9887999999999999e-05 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-17T16:43:26.271 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:26.272 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:26.273 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:26.270+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:26.274 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T16:43:26.373 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:26.370+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:26.426 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:43:26.426 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [], 2024-09-17T16:43:26.426 INFO:teuthology.orchestra.run.smithi060.stdout: "num_ops": 0 2024-09-17T16:43:26.426 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:43:26.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T16:43:26.447 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:26.448 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:26.451 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:381: done (1 left) 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:382: rollback oid 40 current snap is 38 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 40 to 33 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:380: finishing copy_from racing read to smithi18337221-10 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:380: finishing copy_from to smithi18337221-10 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 10 v 147 (ObjNum 86 snap 13 seq_num 86) dirty exists 2024-09-17T16:43:26.456 INFO:tasks.rados.rados.0.smithi183.stdout:380: done (1 left) 2024-09-17T16:43:26.457 INFO:tasks.rados.rados.0.smithi183.stdout:383: delete oid 19 current snap is 38 2024-09-17T16:43:26.460 INFO:tasks.rados.rados.0.smithi183.stdout:382: finishing rollback tid 0 to smithi18337221-40 2024-09-17T16:43:26.462 INFO:tasks.rados.rados.0.smithi183.stdout:382: finishing rollback tid 1 to smithi18337221-40 2024-09-17T16:43:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:382: finishing rollback tid 2 to smithi18337221-40 2024-09-17T16:43:26.464 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 40 v 72 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-09-17T16:43:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:382: done (1 left) 2024-09-17T16:43:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:383: done (0 left) 2024-09-17T16:43:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:384: rollback oid 34 current snap is 38 2024-09-17T16:43:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:rollback oid 34 to 37 2024-09-17T16:43:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 11 current snap is 38 2024-09-17T16:43:26.465 INFO:tasks.rados.rados.0.smithi183.stdout:385: seq_num 140 ranges {5619712=802816,6422528=425984,6848512=720896,7569408=409600} 2024-09-17T16:43:26.476 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:26.476 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:26.476 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:26.473+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:26.493 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:26.493 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:26.500 INFO:tasks.rados.rados.0.smithi183.stdout:385: writing smithi18337221-11 from 5619712 to 6422528 tid 1 2024-09-17T16:43:26.502 INFO:tasks.rados.rados.0.smithi183.stdout:385: writing smithi18337221-11 from 6422528 to 6848512 tid 2 2024-09-17T16:43:26.506 INFO:tasks.rados.rados.0.smithi183.stdout:385: writing smithi18337221-11 from 6848512 to 7569408 tid 3 2024-09-17T16:43:26.509 INFO:tasks.rados.rados.0.smithi183.stdout:385: writing smithi18337221-11 from 7569408 to 7979008 tid 4 2024-09-17T16:43:26.509 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 43 current snap is 38 2024-09-17T16:43:26.509 INFO:tasks.rados.rados.0.smithi183.stdout:384: finishing rollback tid 0 to smithi18337221-34 2024-09-17T16:43:26.509 INFO:tasks.rados.rados.0.smithi183.stdout:384: finishing rollback tid 1 to smithi18337221-34 2024-09-17T16:43:26.510 INFO:tasks.rados.rados.0.smithi183.stdout:384: finishing rollback tid 2 to smithi18337221-34 2024-09-17T16:43:26.510 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 34 v 157 (ObjNum 125 snap 33 seq_num 125) dirty exists 2024-09-17T16:43:26.510 INFO:tasks.rados.rados.0.smithi183.stdout:386: seq_num 141 ranges {2621440=425984,3047424=573440,3620864=425984,4046848=524288,4571136=425984} 2024-09-17T16:43:26.510 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:26.511 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:26.526 INFO:tasks.rados.rados.0.smithi183.stdout:386: writing smithi18337221-43 from 2621440 to 3047424 tid 1 2024-09-17T16:43:26.529 INFO:tasks.rados.rados.0.smithi183.stdout:386: writing smithi18337221-43 from 3047424 to 3620864 tid 2 2024-09-17T16:43:26.530 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:26.530 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:26.531 INFO:tasks.rados.rados.0.smithi183.stdout:386: writing smithi18337221-43 from 3620864 to 4046848 tid 3 2024-09-17T16:43:26.534 INFO:tasks.rados.rados.0.smithi183.stdout:386: writing smithi18337221-43 from 4046848 to 4571136 tid 4 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:386: writing smithi18337221-43 from 4571136 to 4997120 tid 5 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:384: done (2 left) 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:387: read oid 7 snap -1 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:387: expect (ObjNum 124 snap 32 seq_num 124) 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:388: read oid 44 snap 37 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:388: expect (ObjNum 52 snap 0 seq_num 52) 2024-09-17T16:43:26.537 INFO:tasks.rados.rados.0.smithi183.stdout:389: snap_create 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: finishing write tid 1 to smithi18337221-11 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: finishing write tid 2 to smithi18337221-11 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: finishing write tid 3 to smithi18337221-11 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: finishing write tid 4 to smithi18337221-11 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: finishing write tid 5 to smithi18337221-11 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: finishing write tid 6 to smithi18337221-11 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: oid 11 updating version 0 to 244 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: oid 11 version 244 is already newer than 243 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: oid 11 updating version 244 to 247 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: oid 11 version 247 is already newer than 245 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:385: oid 11 version 247 is already newer than 246 2024-09-17T16:43:26.538 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 247 (ObjNum 140 snap 38 seq_num 140) dirty exists 2024-09-17T16:43:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:385: left oid 11 (ObjNum 140 snap 38 seq_num 140) 2024-09-17T16:43:26.539 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 1 to smithi18337221-43 2024-09-17T16:43:26.547 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 2 to smithi18337221-43 2024-09-17T16:43:26.548 INFO:tasks.rados.rados.0.smithi183.stdout:388: expect (ObjNum 52 snap 0 seq_num 52) 2024-09-17T16:43:26.553 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:26.553 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:26.555 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1227397 2024-09-17T16:43:26.560 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 213998 2024-09-17T16:43:26.571 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:26.571 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:26.571 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:26.571 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:26.574 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:26.572+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:26.576 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:26.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T16:43:26.588 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:26.588 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:26.595 INFO:tasks.rados.rados.0.smithi183.stdout:387: expect (ObjNum 124 snap 32 seq_num 124) 2024-09-17T16:43:26.601 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1022774 2024-09-17T16:43:26.606 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:26.606 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:26.612 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:26.623 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:26.623 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:26.634 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:26.640 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:26.641 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 3 to smithi18337221-43 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 4 to smithi18337221-43 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 5 to smithi18337221-43 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 6 to smithi18337221-43 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: finishing write tid 7 to smithi18337221-43 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: oid 43 updating version 0 to 160 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: oid 43 updating version 160 to 163 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: oid 43 version 163 is already newer than 159 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: oid 43 updating version 163 to 164 2024-09-17T16:43:26.656 INFO:tasks.rados.rados.0.smithi183.stdout:386: oid 43 version 164 is already newer than 161 2024-09-17T16:43:26.657 INFO:tasks.rados.rados.0.smithi183.stdout:386: oid 43 version 164 is already newer than 162 2024-09-17T16:43:26.657 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 43 v 164 (ObjNum 141 snap 38 seq_num 141) dirty exists 2024-09-17T16:43:26.657 INFO:tasks.rados.rados.0.smithi183.stdout:386: left oid 43 (ObjNum 141 snap 38 seq_num 141) 2024-09-17T16:43:26.657 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:26.674 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:26.674 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:26.675 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:26.672+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:26.691 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:26.689+0000 7f3e1bfff640 0 -- 172.21.15.60:0/3595427582 >> [v2:172.21.15.111:6824/3233790125,v1:172.21.15.111:6825/3233790125] conn(0x7f3e242213c0 msgr2=0x7f3e242237b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:43:26.696 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:26.696 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:26.705 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-09-17T16:43:26.775 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:26.773+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:26.853 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:26.853 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:26.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-09-17T16:43:26.876 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:26.874+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:26.927 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:26.927 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:26.960 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:26.960 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:26.977 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:26.975+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:26.994 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:26.994 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-09-17T16:43:27.087 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:27.084+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:27.150 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:27.150 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-09-17T16:43:27.179 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:27.176+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:27.280 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:27.278+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:27.306 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:27.306 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-09-17T16:43:27.381 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:27.378+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:27.422 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:27.422 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-09-17T16:43:27.457 INFO:tasks.rados.rados.0.smithi183.stdout:385: done (4 left) 2024-09-17T16:43:27.457 INFO:tasks.rados.rados.0.smithi183.stdout:386: done (3 left) 2024-09-17T16:43:27.457 INFO:tasks.rados.rados.0.smithi183.stdout:387: done (2 left) 2024-09-17T16:43:27.457 INFO:tasks.rados.rados.0.smithi183.stdout:388: done (1 left) 2024-09-17T16:43:27.457 INFO:tasks.rados.rados.0.smithi183.stdout:389: done (0 left) 2024-09-17T16:43:27.457 INFO:tasks.rados.rados.0.smithi183.stdout:390: read oid 43 snap -1 2024-09-17T16:43:27.458 INFO:tasks.rados.rados.0.smithi183.stdout:390: expect (ObjNum 141 snap 38 seq_num 141) 2024-09-17T16:43:27.458 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 11 current snap is 39 2024-09-17T16:43:27.458 INFO:tasks.rados.rados.0.smithi183.stdout:391: seq_num 142 ranges {7979008=442368,8421376=720896,9142272=540672,9682944=688128} 2024-09-17T16:43:27.482 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:27.480+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:27.504 INFO:tasks.rados.rados.0.smithi183.stdout:391: writing smithi18337221-11 from 7979008 to 8421376 tid 1 2024-09-17T16:43:27.508 INFO:tasks.rados.rados.0.smithi183.stdout:391: writing smithi18337221-11 from 8421376 to 9142272 tid 2 2024-09-17T16:43:27.511 INFO:tasks.rados.rados.0.smithi183.stdout:391: writing smithi18337221-11 from 9142272 to 9682944 tid 3 2024-09-17T16:43:27.515 INFO:tasks.rados.rados.0.smithi183.stdout:391: writing smithi18337221-11 from 9682944 to 10371072 tid 4 2024-09-17T16:43:27.515 INFO:tasks.rados.rados.0.smithi183.stdout:392: copy_from oid 27 from oid 2 current snap is 39 2024-09-17T16:43:27.515 INFO:tasks.rados.rados.0.smithi183.stdout:390: expect (ObjNum 141 snap 38 seq_num 141) 2024-09-17T16:43:27.539 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 3875201 2024-09-17T16:43:27.550 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:27.584 INFO:tasks.ceph.osd.14.smithi111.stderr:2024-09-17T16:43:27.581+0000 7fdf7c8bf640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 32992) UID: 0 2024-09-17T16:43:27.585 INFO:teuthology.orchestra.run.smithi060.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:27.585 INFO:teuthology.orchestra.run.smithi060.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.598 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T16:43:27.630 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 3203804 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: finishing write tid 1 to smithi18337221-11 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: finishing write tid 2 to smithi18337221-11 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: finishing write tid 3 to smithi18337221-11 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: finishing write tid 4 to smithi18337221-11 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: finishing write tid 5 to smithi18337221-11 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: finishing write tid 6 to smithi18337221-11 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: oid 11 updating version 0 to 252 2024-09-17T16:43:27.649 INFO:tasks.rados.rados.0.smithi183.stdout:391: oid 11 version 252 is already newer than 250 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:391: oid 11 version 252 is already newer than 251 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:391: oid 11 version 252 is already newer than 249 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:391: oid 11 updating version 252 to 253 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 253 (ObjNum 142 snap 39 seq_num 142) dirty exists 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:391: left oid 11 (ObjNum 142 snap 39 seq_num 142) 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:392: finishing copy_from racing read to smithi18337221-27 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:392: finishing copy_from to smithi18337221-27 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 27 v 72 (ObjNum 82 snap 13 seq_num 82) dirty exists 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:390: done (2 left) 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:391: done (1 left) 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:392: done (0 left) 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 2 current snap is 39 2024-09-17T16:43:27.650 INFO:tasks.rados.rados.0.smithi183.stdout:393: seq_num 143 ranges {1425408=458752,1884160=475136,2359296=655360,3014656=671744,3686400=147456} 2024-09-17T16:43:27.658 INFO:tasks.rados.rados.0.smithi183.stdout:393: writing smithi18337221-2 from 1425408 to 1884160 tid 1 2024-09-17T16:43:27.661 INFO:tasks.rados.rados.0.smithi183.stdout:393: writing smithi18337221-2 from 1884160 to 2359296 tid 2 2024-09-17T16:43:27.665 INFO:tasks.rados.rados.0.smithi183.stdout:393: writing smithi18337221-2 from 2359296 to 3014656 tid 3 2024-09-17T16:43:27.670 INFO:tasks.rados.rados.0.smithi183.stdout:393: writing smithi18337221-2 from 3014656 to 3686400 tid 4 2024-09-17T16:43:27.671 INFO:tasks.rados.rados.0.smithi183.stdout:393: writing smithi18337221-2 from 3686400 to 3833856 tid 5 2024-09-17T16:43:27.671 INFO:tasks.rados.rados.0.smithi183.stdout:394: delete oid 1 current snap is 39 2024-09-17T16:43:27.671 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 1 to smithi18337221-2 2024-09-17T16:43:27.673 INFO:tasks.rados.rados.0.smithi183.stdout:394: done (1 left) 2024-09-17T16:43:27.673 INFO:tasks.rados.rados.0.smithi183.stdout:395: snap_create 2024-09-17T16:43:27.678 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 2 to smithi18337221-2 2024-09-17T16:43:27.679 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 3 to smithi18337221-2 2024-09-17T16:43:27.681 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 4 to smithi18337221-2 2024-09-17T16:43:27.681 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 5 to smithi18337221-2 2024-09-17T16:43:27.682 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 6 to smithi18337221-2 2024-09-17T16:43:27.683 INFO:tasks.rados.rados.0.smithi183.stdout:393: finishing write tid 7 to smithi18337221-2 2024-09-17T16:43:27.683 INFO:tasks.rados.rados.0.smithi183.stdout:393: oid 2 updating version 0 to 98 2024-09-17T16:43:27.683 INFO:tasks.rados.rados.0.smithi183.stdout:393: oid 2 updating version 98 to 99 2024-09-17T16:43:27.683 INFO:tasks.rados.rados.0.smithi183.stdout:393: oid 2 updating version 99 to 102 2024-09-17T16:43:27.683 INFO:tasks.rados.rados.0.smithi183.stdout:393: oid 2 updating version 102 to 103 2024-09-17T16:43:27.683 INFO:tasks.rados.rados.0.smithi183.stdout:393: oid 2 version 103 is already newer than 101 2024-09-17T16:43:27.684 INFO:tasks.rados.rados.0.smithi183.stdout:393: oid 2 version 103 is already newer than 100 2024-09-17T16:43:27.684 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 2 v 103 (ObjNum 143 snap 39 seq_num 143) dirty exists 2024-09-17T16:43:27.684 INFO:tasks.rados.rados.0.smithi183.stdout:393: left oid 2 (ObjNum 143 snap 39 seq_num 143) 2024-09-17T16:43:27.685 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:27.682+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:27.709 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:27.710 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.718 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-17T16:43:27.802 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:27.799+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:27.859 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:27.860 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:27.868 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-17T16:43:27.909 INFO:tasks.ceph.osd.13.smithi098.stderr:2024-09-17T16:43:27.906+0000 7f6831dee640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 33050) UID: 0 2024-09-17T16:43:27.987 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:27.984+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:28.011 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.011 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.019 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T16:43:28.088 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:28.086+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:28.162 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.162 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.170 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T16:43:28.189 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:28.187+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:28.273 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.273 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.282 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T16:43:28.289 INFO:tasks.ceph.osd.15.smithi183.stderr:2024-09-17T16:43:28.287+0000 7f4c07dbd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 33517) UID: 0 2024-09-17T16:43:28.385 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.385 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.390 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:28.388+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:28.393 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-09-17T16:43:28.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T16:43:28.488 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 13] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-09-17T16:43:28.488 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T16:43:28.488 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2024-09-17T16:43:28.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:43:28.491 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:28.489+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:28.496 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.496 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.505 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-09-17T16:43:28.592 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:28.590+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:393: done (1 left) 2024-09-17T16:43:28.595 INFO:tasks.rados.rados.0.smithi183.stdout:395: done (0 left) 2024-09-17T16:43:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:396: read oid 33 snap 39 2024-09-17T16:43:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:396: expect (ObjNum 68 snap 10 seq_num 68) 2024-09-17T16:43:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 11 current snap is 40 2024-09-17T16:43:28.596 INFO:tasks.rados.rados.0.smithi183.stdout:397: seq_num 145 ranges {10371072=32768} 2024-09-17T16:43:28.612 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.612 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.622 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-09-17T16:43:28.650 INFO:tasks.rados.rados.0.smithi183.stdout:397: writing smithi18337221-11 from 10371072 to 10403840 tid 1 2024-09-17T16:43:28.650 INFO:tasks.rados.rados.0.smithi183.stdout:append oid 44 current snap is 40 2024-09-17T16:43:28.650 INFO:tasks.rados.rados.0.smithi183.stdout:398: seq_num 146 ranges {1622016=49152} 2024-09-17T16:43:28.659 INFO:tasks.rados.rados.0.smithi183.stdout:398: writing smithi18337221-44 from 1622016 to 1671168 tid 1 2024-09-17T16:43:28.659 INFO:tasks.rados.rados.0.smithi183.stdout:399: snap_remove snap 37 2024-09-17T16:43:28.693 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:28.690+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:28.727 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.727 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.735 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-09-17T16:43:28.794 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:28.791+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:28.830 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:43:28.830 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:43:28.838 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.839 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.841 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-17T16:43:28.592242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105644595,"num_objects":67,"num_object_clones":19,"num_object_copies":449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":3,"num_read":527,"num_read_kb":141088,"num_write":1027,"num_write_kb":145560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":136090163,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1618,"ondisk_log_size":1618,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":738888,"kb_used_data":203720,"kb_used_omap":24,"kb_used_meta":534759,"kb_avail":1509210552,"statfs":{"total":1546188226560,"available":1545431605248,"internally_reserved":0,"allocated":208609280,"data_stored":237186518,"data_compressed":2872630,"data_compressed_allocated":5832704,"data_compressed_original":12570624,"omap_allocated":25521,"internal_metadata":547593295},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":933888,"num_objects":-10,"num_object_clones":-10,"num_object_copies":-70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-7,"num_objects_unfound":0,"num_objects_dirty":-10,"num_whiteouts":-1,"num_read":22,"num_read_kb":25309,"num_write":70,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":19251200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.136721"},"pg_stats":[{"pgid":"3.f","version":"103'30","reported_seq":215,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.454927+0000","last_change":"2024-09-17T16:43:26.454559+0000","last_active":"2024-09-17T16:43:27.454927+0000","last_peered":"2024-09-17T16:43:27.454927+0000","last_clean":"2024-09-17T16:43:27.454927+0000","last_became_active":"2024-09-17T16:43:24.463619+0000","last_became_peered":"2024-09-17T16:43:24.463619+0000","last_unstale":"2024-09-17T16:43:27.454927+0000","last_undegraded":"2024-09-17T16:43:27.454927+0000","last_fullsized":"2024-09-17T16:43:27.454927+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-17T16:43:25.158716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:25.158716+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:28.885249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00063768600000000005,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1542,"num_write":24,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":638976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,14,11,7,10,0],"acting":[13,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.e","version":"113'164","reported_seq":647,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.467062+0000","last_change":"2024-09-17T16:43:26.454480+0000","last_active":"2024-09-17T16:43:27.467062+0000","last_peered":"2024-09-17T16:43:27.467062+0000","last_clean":"2024-09-17T16:43:27.467062+0000","last_became_active":"2024-09-17T16:43:21.458960+0000","last_became_peered":"2024-09-17T16:43:21.458960+0000","last_unstale":"2024-09-17T16:43:27.467062+0000","last_undegraded":"2024-09-17T16:43:27.467062+0000","last_fullsized":"2024-09-17T16:43:27.467062+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"100'128","last_scrub_stamp":"2024-09-17T16:43:14.235873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:14.235873+0000","objects_scrubbed":9,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:39.829205+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.000560189,"stat_sum":{"num_bytes":7667712,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":14688,"num_write":68,"num_write_kb":13840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":10534912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,13,8,6,12],"acting":[2,11,5,13,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.d","version":"111'39","reported_seq":84,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.464453+0000","last_change":"2024-09-17T16:43:25.151730+0000","last_active":"2024-09-17T16:43:25.464453+0000","last_peered":"2024-09-17T16:43:25.464453+0000","last_clean":"2024-09-17T16:43:25.464453+0000","last_became_active":"2024-09-17T16:43:24.464227+0000","last_became_peered":"2024-09-17T16:43:24.464227+0000","last_unstale":"2024-09-17T16:43:25.464453+0000","last_undegraded":"2024-09-17T16:43:25.464453+0000","last_fullsized":"2024-09-17T16:43:25.464453+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39","last_scrub_stamp":"2024-09-17T16:43:25.151576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:25.151576+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:39.720849+0000","scrub_duration":5,"objects_trimmed":1,"snaptrim_duration":0.0067553020000000004,"stat_sum":{"num_bytes":4882432,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":699,"num_write":31,"num_write_kb":5088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":6569984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,14,10,9,8,4],"acting":[13,1,14,10,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"3.c","version":"111'239","reported_seq":786,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-17T16:43:24.479187+0000","last_change":"2024-09-17T16:43:23.476813+0000","last_active":"2024-09-17T16:43:24.479187+0000","last_peered":"2024-09-17T16:43:24.479187+0000","last_clean":"2024-09-17T16:43:24.479187+0000","last_became_active":"2024-09-17T16:43:21.458478+0000","last_became_peered":"2024-09-17T16:43:21.458478+0000","last_unstale":"2024-09-17T16:43:24.479187+0000","last_undegraded":"2024-09-17T16:43:24.479187+0000","last_fullsized":"2024-09-17T16:43:24.479187+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:26.681634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01589815,"stat_sum":{"num_bytes":19316736,"num_objects":11,"num_object_clones":3,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":25033,"num_write":202,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,10,6,12,3],"acting":[5,8,13,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"3.b","version":"113'169","reported_seq":561,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.453961+0000","last_change":"2024-09-17T16:43:26.467008+0000","last_active":"2024-09-17T16:43:27.453961+0000","last_peered":"2024-09-17T16:43:27.453961+0000","last_clean":"2024-09-17T16:43:27.453961+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:43:27.453961+0000","last_undegraded":"2024-09-17T16:43:27.453961+0000","last_fullsized":"2024-09-17T16:43:27.453961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088823429999999991,"stat_sum":{"num_bytes":14876672,"num_objects":7,"num_object_clones":2,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":10454,"num_write":56,"num_write_kb":20704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.a","version":"111'81","reported_seq":79,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.465128+0000","last_change":"2024-09-17T16:43:24.470497+0000","last_active":"2024-09-17T16:43:25.465128+0000","last_peered":"2024-09-17T16:43:25.465128+0000","last_clean":"2024-09-17T16:43:25.465128+0000","last_became_active":"2024-09-17T16:43:24.463623+0000","last_became_peered":"2024-09-17T16:43:24.463623+0000","last_unstale":"2024-09-17T16:43:25.465128+0000","last_undegraded":"2024-09-17T16:43:25.465128+0000","last_fullsized":"2024-09-17T16:43:25.465128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:31.970145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050119350000000003,"stat_sum":{"num_bytes":8880128,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":9728,"num_write":49,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":14352384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,14,6,10],"acting":[13,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"3.9","version":"113'68","reported_seq":463,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.460148+0000","last_change":"2024-09-17T16:43:26.460148+0000","last_active":"2024-09-17T16:43:26.460148+0000","last_peered":"2024-09-17T16:43:26.460148+0000","last_clean":"2024-09-17T16:43:26.460148+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:43:26.460148+0000","last_undegraded":"2024-09-17T16:43:26.460148+0000","last_fullsized":"2024-09-17T16:43:26.460148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'66","last_scrub_stamp":"2024-09-17T16:43:25.718088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:25.718088+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:34.300762+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0029539700000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":20,"num_read_kb":5251,"num_write":38,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.8","version":"113'60","reported_seq":463,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.471499+0000","last_change":"2024-09-17T16:43:26.472145+0000","last_active":"2024-09-17T16:43:26.471499+0000","last_peered":"2024-09-17T16:43:26.471499+0000","last_clean":"2024-09-17T16:43:26.471499+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:43:26.471499+0000","last_undegraded":"2024-09-17T16:43:26.471499+0000","last_fullsized":"2024-09-17T16:43:26.471499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:32.973807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.008617431,"stat_sum":{"num_bytes":1835008,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":8210,"num_write":94,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"1.0","version":"24'92","reported_seq":189,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463399+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:43:26.463399+0000","last_peered":"2024-09-17T16:43:26.463399+0000","last_clean":"2024-09-17T16:43:26.463399+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:43:26.463399+0000","last_undegraded":"2024-09-17T16:43:26.463399+0000","last_fullsized":"2024-09-17T16:43:26.463399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:06.994581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463057+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:43:26.463057+0000","last_peered":"2024-09-17T16:43:26.463057+0000","last_clean":"2024-09-17T16:43:26.463057+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:43:26.463057+0000","last_undegraded":"2024-09-17T16:43:26.463057+0000","last_fullsized":"2024-09-17T16:43:26.463057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":408,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463369+0000","last_change":"2024-09-17T16:43:26.463749+0000","last_active":"2024-09-17T16:43:26.463369+0000","last_peered":"2024-09-17T16:43:26.463369+0000","last_clean":"2024-09-17T16:43:26.463369+0000","last_became_active":"2024-09-17T16:43:18.466415+0000","last_became_peered":"2024-09-17T16:43:18.466415+0000","last_unstale":"2024-09-17T16:43:26.463369+0000","last_undegraded":"2024-09-17T16:43:26.463369+0000","last_fullsized":"2024-09-17T16:43:26.463369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066801499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,13,1,5,3,7],"acting":[11,2,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.460894+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:43:26.460894+0000","last_peered":"2024-09-17T16:43:26.460894+0000","last_clean":"2024-09-17T16:43:26.460894+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:43:26.460894+0000","last_undegraded":"2024-09-17T16:43:26.460894+0000","last_fullsized":"2024-09-17T16:43:26.460894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"110'96","reported_seq":562,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.454080+0000","last_change":"2024-09-17T16:43:26.458681+0000","last_active":"2024-09-17T16:43:27.454080+0000","last_peered":"2024-09-17T16:43:27.454080+0000","last_clean":"2024-09-17T16:43:27.454080+0000","last_became_active":"2024-09-17T16:43:18.465873+0000","last_became_peered":"2024-09-17T16:43:18.465873+0000","last_unstale":"2024-09-17T16:43:27.454080+0000","last_undegraded":"2024-09-17T16:43:27.454080+0000","last_fullsized":"2024-09-17T16:43:27.454080+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063089199999999998,"stat_sum":{"num_bytes":5275648,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":6564,"num_write":68,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":13828096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,3,11,10,2,7],"acting":[4,13,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.452287+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:43:26.452287+0000","last_peered":"2024-09-17T16:43:26.452287+0000","last_clean":"2024-09-17T16:43:26.452287+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:43:26.452287+0000","last_undegraded":"2024-09-17T16:43:26.452287+0000","last_fullsized":"2024-09-17T16:43:26.452287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"110'82","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.457602+0000","last_change":"2024-09-17T16:43:26.457992+0000","last_active":"2024-09-17T16:43:26.457602+0000","last_peered":"2024-09-17T16:43:26.457602+0000","last_clean":"2024-09-17T16:43:26.457602+0000","last_became_active":"2024-09-17T16:43:18.464798+0000","last_became_peered":"2024-09-17T16:43:18.464798+0000","last_unstale":"2024-09-17T16:43:26.457602+0000","last_undegraded":"2024-09-17T16:43:26.457602+0000","last_fullsized":"2024-09-17T16:43:26.457602+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'68","last_scrub_stamp":"2024-09-17T16:43:15.695149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:15.695149+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:16.734774+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00077978800000000001,"stat_sum":{"num_bytes":8617984,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":2762,"num_write":50,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":17825792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,13,11,4],"acting":[14,2,9,3,13,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.2","version":"30'2","reported_seq":104,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.464038+0000","last_change":"2024-09-17T16:43:24.563642+0000","last_active":"2024-09-17T16:43:25.464038+0000","last_peered":"2024-09-17T16:43:25.464038+0000","last_clean":"2024-09-17T16:43:25.464038+0000","last_became_active":"2024-09-17T16:43:24.463168+0000","last_became_peered":"2024-09-17T16:43:24.463168+0000","last_unstale":"2024-09-17T16:43:25.464038+0000","last_undegraded":"2024-09-17T16:43:25.464038+0000","last_fullsized":"2024-09-17T16:43:25.464038+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:41.340854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"3.3","version":"113'72","reported_seq":528,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.460921+0000","last_change":"2024-09-17T16:43:26.453026+0000","last_active":"2024-09-17T16:43:26.460921+0000","last_peered":"2024-09-17T16:43:26.460921+0000","last_clean":"2024-09-17T16:43:26.460921+0000","last_became_active":"2024-09-17T16:43:18.465306+0000","last_became_peered":"2024-09-17T16:43:18.465306+0000","last_unstale":"2024-09-17T16:43:26.460921+0000","last_undegraded":"2024-09-17T16:43:26.460921+0000","last_fullsized":"2024-09-17T16:43:26.460921+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'48","last_scrub_stamp":"2024-09-17T16:43:15.469504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:15.469504+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:23.289468+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00056740800000000004,"stat_sum":{"num_bytes":1327104,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":3202,"num_write":23,"num_write_kb":4912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":8093696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,13,2,10,5],"acting":[15,9,4,13,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.5","version":"110'103","reported_seq":494,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-17T16:43:24.461045+0000","last_change":"2024-09-17T16:43:24.004583+0000","last_active":"2024-09-17T16:43:24.461045+0000","last_peered":"2024-09-17T16:43:24.461045+0000","last_clean":"2024-09-17T16:43:24.461045+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:43:24.461045+0000","last_undegraded":"2024-09-17T16:43:24.461045+0000","last_fullsized":"2024-09-17T16:43:24.461045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'103","last_scrub_stamp":"2024-09-17T16:43:24.004454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.004454+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:26.122626+0000","scrub_duration":7,"objects_trimmed":2,"snaptrim_duration":0.015587001,"stat_sum":{"num_bytes":6635520,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":7743,"num_write":50,"num_write_kb":8608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463052+0000","last_change":"2024-09-17T16:42:45.450049+0000","last_active":"2024-09-17T16:43:26.463052+0000","last_peered":"2024-09-17T16:43:26.463052+0000","last_clean":"2024-09-17T16:43:26.463052+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:43:26.463052+0000","last_undegraded":"2024-09-17T16:43:26.463052+0000","last_fullsized":"2024-09-17T16:43:26.463052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"110'72","reported_seq":479,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.512178+0000","last_change":"2024-09-17T16:43:26.466663+0000","last_active":"2024-09-17T16:43:27.512178+0000","last_peered":"2024-09-17T16:43:27.512178+0000","last_clean":"2024-09-17T16:43:27.512178+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:43:27.512178+0000","last_undegraded":"2024-09-17T16:43:27.512178+0000","last_fullsized":"2024-09-17T16:43:27.512178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'72","last_scrub_stamp":"2024-09-17T16:43:23.673462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:23.673462+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:46.749493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0014671479999999999,"stat_sum":{"num_bytes":5062656,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":27,"num_read_kb":15295,"num_write":22,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.470579+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:43:25.470579+0000","last_peered":"2024-09-17T16:43:25.470579+0000","last_clean":"2024-09-17T16:43:25.470579+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:43:25.470579+0000","last_undegraded":"2024-09-17T16:43:25.470579+0000","last_fullsized":"2024-09-17T16:43:25.470579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"113'142","reported_seq":616,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.454080+0000","last_change":"2024-09-17T16:43:26.470886+0000","last_active":"2024-09-17T16:43:27.454080+0000","last_peered":"2024-09-17T16:43:27.454080+0000","last_clean":"2024-09-17T16:43:27.454080+0000","last_became_active":"2024-09-17T16:43:21.458094+0000","last_became_peered":"2024-09-17T16:43:21.458094+0000","last_unstale":"2024-09-17T16:43:27.454080+0000","last_undegraded":"2024-09-17T16:43:27.454080+0000","last_fullsized":"2024-09-17T16:43:27.454080+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'112","last_scrub_stamp":"2024-09-17T16:43:15.276425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:15.276425+0000","objects_scrubbed":9,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:29.722350+0000","scrub_duration":7,"objects_trimmed":1,"snaptrim_duration":0.012525675999999999,"stat_sum":{"num_bytes":12337152,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":18564,"num_write":85,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":23871488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,13],"acting":[4,6,7,0,11,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.507306+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:43:27.507306+0000","last_peered":"2024-09-17T16:43:27.507306+0000","last_clean":"2024-09-17T16:43:27.507306+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:43:27.507306+0000","last_undegraded":"2024-09-17T16:43:27.507306+0000","last_fullsized":"2024-09-17T16:43:27.507306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:05.616046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"110'106","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.465052+0000","last_change":"2024-09-17T16:43:26.468430+0000","last_active":"2024-09-17T16:43:26.465052+0000","last_peered":"2024-09-17T16:43:26.465052+0000","last_clean":"2024-09-17T16:43:26.465052+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:43:26.465052+0000","last_undegraded":"2024-09-17T16:43:26.465052+0000","last_fullsized":"2024-09-17T16:43:26.465052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"100'88","last_scrub_stamp":"2024-09-17T16:43:14.054959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:14.054959+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:43.128595+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00369608,"stat_sum":{"num_bytes":7700480,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":11289,"num_write":42,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.462693+0000","last_change":"2024-09-17T16:43:24.463572+0000","last_active":"2024-09-17T16:43:26.462693+0000","last_peered":"2024-09-17T16:43:26.462693+0000","last_clean":"2024-09-17T16:43:26.462693+0000","last_became_active":"2024-09-17T16:43:24.463182+0000","last_became_peered":"2024-09-17T16:43:24.463182+0000","last_unstale":"2024-09-17T16:43:26.462693+0000","last_undegraded":"2024-09-17T16:43:26.462693+0000","last_fullsized":"2024-09-17T16:43:26.462693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:26.377269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":105054208,"num_objects":63,"num_object_clones":19,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":3,"num_read":451,"num_read_kb":141024,"num_write":902,"num_write_kb":143408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":135561216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":185913344,"data_stored":219901952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182425,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":5172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":5296128,"data_stored":5598062,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182425,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39772,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":8781824,"data_stored":9986728,"data_compressed":178680,"data_compressed_allocated":360448,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182425,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48088,"kb_used_data":16900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323752,"statfs":{"total":96636764160,"available":96587522048,"internally_reserved":0,"allocated":17305600,"data_stored":20214984,"data_compressed":185951,"data_compressed_allocated":393216,"data_compressed_original":1245184,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280535,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43224,"kb_used_data":12032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328616,"statfs":{"total":96636764160,"available":96592502784,"internally_reserved":0,"allocated":12320768,"data_stored":12946286,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280534,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54516,"kb_used_data":23328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317324,"statfs":{"total":96636764160,"available":96580939776,"internally_reserved":0,"allocated":23887872,"data_stored":23566361,"data_compressed":172510,"data_compressed_allocated":348160,"data_compressed_original":696320,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280535,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":8974336,"data_stored":12414350,"data_compressed":187193,"data_compressed_allocated":397312,"data_compressed_original":1241088,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280535,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46968,"kb_used_data":15776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324872,"statfs":{"total":96636764160,"available":96588668928,"internally_reserved":0,"allocated":16154624,"data_stored":17828718,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313240,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":12680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":12984320,"data_stored":18859004,"data_compressed":182795,"data_compressed_allocated":368640,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313240,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":8404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":8605696,"data_stored":9538414,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247832,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44032,"kb_used_data":12836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327808,"statfs":{"total":96636764160,"available":96591675392,"internally_reserved":0,"allocated":13144064,"data_stored":14102772,"data_compressed":174567,"data_compressed_allocated":352256,"data_compressed_original":704512,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215126,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":8344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":8544256,"data_stored":8767938,"data_compressed":176623,"data_compressed_allocated":356352,"data_compressed_original":712704,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215129,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67164,"kb_used_data":17920,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94304676,"statfs":{"total":96636764160,"available":96567988224,"internally_reserved":0,"allocated":18350080,"data_stored":20826562,"data_compressed":176623,"data_compressed_allocated":356352,"data_compressed_original":712704,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215128,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65368,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306472,"statfs":{"total":96636764160,"available":96569827328,"internally_reserved":0,"allocated":16510976,"data_stored":18950594,"data_compressed":176623,"data_compressed_allocated":356352,"data_compressed_original":712704,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215128,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47472,"kb_used_data":12124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":12414976,"data_stored":13480635,"data_compressed":178680,"data_compressed_allocated":360448,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41984,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329856,"statfs":{"total":96636764160,"available":96593772544,"internally_reserved":0,"allocated":11051008,"data_stored":14842734,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182423,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45136,"kb_used_data":13948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326704,"statfs":{"total":96636764160,"available":96590544896,"internally_reserved":0,"allocated":14282752,"data_stored":15262376,"data_compressed":178680,"data_compressed_allocated":360448,"data_compressed_original":720896,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11005952,"data_stored":11956224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7618560,"data_stored":8163328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8003584,"data_stored":11649024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9736192,"data_stored":13852672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15073280,"data_stored":17428480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11866112,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17424384,"data_stored":20221952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12427264,"data_stored":13254656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":11657216,"data_stored":17858560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":8548352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":15220736,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":19595264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":11108352,"data_stored":12500992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":20017152,"data_stored":20017152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":7479296,"data_stored":9007104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":3981312,"data_stored":4608000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:43:28.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pgp_num 16 2024-09-17T16:43:28.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-09-17T16:43:28.932 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:28.929+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:28.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T16:43:28.989 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:28.989 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:28.997 DEBUG:teuthology.orchestra.run.smithi098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-09-17T16:43:29.016 INFO:tasks.ceph.osd.8.smithi060.stderr:2024-09-17T16:43:29.013+0000 7fa53f556640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 33886) UID: 0 2024-09-17T16:43:29.096 INFO:tasks.ceph.osd.3.smithi183.stderr:2024-09-17T16:43:29.094+0000 7fc792929640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33511) UID: 0 2024-09-17T16:43:29.098 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:29.098 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:29.116 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:29.117 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:29.134 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:29.134 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:29.141 INFO:teuthology.orchestra.run.smithi098.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:29.142 INFO:teuthology.orchestra.run.smithi098.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:29.150 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T16:43:29.151 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:29.167 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:29.167 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:29.184 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:29.197 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:29.195+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:29.201 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:29.202 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:29.219 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:29.219 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:29.235 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:29.236 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:29.252 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:29.252 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:29.266 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:29.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:29.267 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:29.267 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:29.270 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:29.276 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T16:43:29.288 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:29.298 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:29.295+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:29.304 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:29.305 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:29.321 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:29.321 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:29.339 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:29.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:29.337+0000 7f763cf31640 0 -- 172.21.15.60:0/1442477036 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f7638224250 msgr2=0x7f7638226640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T16:43:29.380 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:29.381 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:29.381 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:29.381 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:29.381 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:29.389 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T16:43:29.433 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:29.431+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:288 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~376832] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 66.032378358000003, 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018124781, 2024-09-17T16:43:29.494 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 288 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.495 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458511+0000", 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.458512+0000", 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.201e-06 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459021+0000", 2024-09-17T16:43:29.496 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000508696 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459036+0000", 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4946000000000001e-05 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459044+0000", 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2330000000000006e-06 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.497 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5349000000000001e-05 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459105+0000", 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2959999999999998e-06 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467231+0000", 2024-09-17T16:43:29.498 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0081265810000000008 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.467343+0000", 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000111366 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.468193+0000", 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085095400000000001 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.499 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472015+0000", 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038219119999999998 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476572+0000", 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045570619999999997 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476636+0000", 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3184999999999999e-05 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.500 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:289 3.es0 3:7af0cf48:::smithi18337221-43:head [setxattr _header (56) in=7b] snapc a=[a,9,8,7,6] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 66.031825576000003, 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017770232, 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.501 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 289 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.502 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459064+0000", 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5199999999999996e-07 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459069+0000", 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4830000000000001e-06 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459077+0000", 2024-09-17T16:43:29.503 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1880000000000002e-06 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459083+0000", 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3620000000000002e-06 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459130+0000", 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6876000000000003e-05 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.504 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459135+0000", 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3340000000000003e-06 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471144+0000", 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012009117999999999 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471236+0000", 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2281999999999995e-05 2024-09-17T16:43:29.505 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471658+0000", 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00042205299999999998 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.472216+0000", 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055826699999999999 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476768+0000", 2024-09-17T16:43:29.506 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0045520710000000004 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.476834+0000", 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5445999999999996e-05 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:290 3.es0 3:7af0cf48:::smithi18337221-43:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e50)", 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 66.031790444999999, 2024-09-17T16:43:29.507 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021360535999999999, 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 290 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:29.508 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459099+0000", 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.509 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459107+0000", 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2930000000000003e-06 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459115+0000", 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.208e-06 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459121+0000", 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1720000000000004e-06 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459161+0000", 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9637e-05 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting_for_map not empty", 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.459168+0000", 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3000000000000004e-06 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471869+0000", 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012700899 2024-09-17T16:43:29.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.471947+0000", 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8330000000000004e-05 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477178+0000", 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052311160000000001 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.477230+0000", 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1366999999999998e-05 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:23.480459+0000", 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0032295029999999999 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:353 3.es0 3:7af0cf48:::smithi18337221-43:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:43:29.513 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 61.011376861999999, 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030354281, 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 353 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:43:29.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479512+0000", 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479514+0000", 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4649999999999999e-06 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479520+0000", 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7910000000000001e-06 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479530+0000", 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0753e-05 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479539+0000", 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9260000000000006e-06 2024-09-17T16:43:29.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.479975+0000", 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043575500000000002 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.480105+0000", 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00013020600000000001 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490191+0000", 2024-09-17T16:43:29.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010086247 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501337+0000", 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011145446999999999 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509772+0000", 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0084349049999999995 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509867+0000", 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4785999999999997e-05 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:355 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~475136] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 61.002788793000001, 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022143336, 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.519 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 355 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488100+0000", 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488102+0000", 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1119999999999999e-06 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.488993+0000", 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00089148899999999998 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489004+0000", 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1270000000000001e-05 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489012+0000", 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9729999999999997e-06 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495281+0000", 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0062688559999999997 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.495381+0000", 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100233 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496316+0000", 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00093481 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509884+0000", 2024-09-17T16:43:29.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013567932 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510170+0000", 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028624299999999999 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510244+0000", 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3417999999999994e-05 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:356 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~622592] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.998738566999997, 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01999051, 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 356 2024-09-17T16:43:29.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492151+0000", 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492153+0000", 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.911e-06 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492881+0000", 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072854300000000001 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492894+0000", 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2435e-05 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492902+0000", 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0690000000000002e-06 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501528+0000", 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0086269080000000008 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.501643+0000", 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011425399999999999 2024-09-17T16:43:29.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.502627+0000", 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00098378000000000007 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.509887+0000", 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0072604310000000003 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512095+0000", 2024-09-17T16:43:29.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0022076079999999998 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512141+0000", 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6570999999999998e-05 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:357 3.es0 3:7858efeb:::smithi18337221-46:head [append 0~147456] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:29.530 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.997971509999999, 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020343033999999999, 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 357 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:29.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492918+0000", 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8800000000000002e-07 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492986+0000", 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7827e-05 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492993+0000", 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8709999999999999e-06 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.492999+0000", 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6500000000000001e-06 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507458+0000", 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014459013999999999 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507570+0000", 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011199199999999999 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.508224+0000", 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00065380799999999997 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510045+0000", 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018218609999999999 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513184+0000", 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0031387979999999999 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513261+0000", 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6425000000000001e-05 2024-09-17T16:43:29.535 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:358 3.es0 3:7858efeb:::smithi18337221-46:head [setxattr _header (57) in=7b] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.997880787, 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020438640000000001, 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 358 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493008+0000", 2024-09-17T16:43:29.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493009+0000", 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5000000000000003e-07 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493012+0000", 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8150000000000002e-06 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.538 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493019+0000", 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3490000000000003e-06 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493024+0000", 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8690000000000003e-06 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510349+0000", 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017324736 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510406+0000", 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7293000000000002e-05 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510704+0000", 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000298101 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511712+0000", 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001008227 2024-09-17T16:43:29.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513366+0000", 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016533780000000001 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513447+0000", 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1322000000000005e-05 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:359 3.es0 3:7858efeb:::smithi18337221-46:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.997857408000002, 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.021336417999999999, 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 359 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493032+0000", 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.34e-07 2024-09-17T16:43:29.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493036+0000", 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8010000000000001e-06 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493041+0000", 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9910000000000002e-06 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493046+0000", 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8409999999999999e-06 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511258+0000", 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018211793 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511428+0000", 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017049099999999999 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513824+0000", 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002395533 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.513926+0000", 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102079 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.514368+0000", 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044245500000000002 2024-09-17T16:43:29.546 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:360 3.es0 3:78f58299:::smithi18337221-26:head [copy-from ver 4] snapc c=[c,b,9,8] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.997836397, 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.028558304999999999, 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.547 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 360 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493053+0000", 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.46e-07 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493057+0000", 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9099999999999998e-06 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493062+0000", 2024-09-17T16:43:29.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5530000000000003e-06 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493066+0000", 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5719999999999996e-06 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511762+0000", 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018695494 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.511863+0000", 2024-09-17T16:43:29.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010166999999999999 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.515440+0000", 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003576419 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517437+0000", 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019973209999999998 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521513+0000", 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0040760140000000002 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.521611+0000", 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7905999999999994e-05 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.552 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:361 3.es0 3:78f58299:::smithi18337221-26:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.997816290999999, 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024151737999999999, 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 361 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493073+0000", 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7899999999999999e-07 2024-09-17T16:43:29.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493075+0000", 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1090000000000001e-06 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493082+0000", 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4749999999999998e-06 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.493087+0000", 2024-09-17T16:43:29.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6829999999999999e-06 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512244+0000", 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019157789000000001 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for blocked object", 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.512274+0000", 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9258e-05 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517080+0000", 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.004806495 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517152+0000", 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1958000000000005e-05 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.517225+0000", 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2491999999999996e-05 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.557 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:643 3.es0 3:7af0cf48:::smithi18337221-43:head [append 0~442368] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.473523+0000", 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 34.017366002000003, 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017311680999999999, 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.558 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 643 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.473523+0000", 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.473523+0000", 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.473524+0000", 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4499999999999996e-07 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.474101+0000", 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00057721400000000005 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.474112+0000", 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0793e-05 2024-09-17T16:43:29.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.474118+0000", 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6130000000000003e-06 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.478934+0000", 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0048165889999999996 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.479031+0000", 2024-09-17T16:43:29.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6887999999999998e-05 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.479736+0000", 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00070506099999999999 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.487089+0000", 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0073526370000000004 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.490791+0000", 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0037018609999999999 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.490835+0000", 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4180000000000001e-05 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:692 3.es0 3:7af0cf48:::smithi18337221-43:head [copy-from ver 16] snapc 1c=[1c,1b,1a,19,13] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.515291+0000", 2024-09-17T16:43:29.563 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 29.975597904000001, 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018399011999999999, 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 692 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515291+0000", 2024-09-17T16:43:29.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515291+0000", 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515293+0000", 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7689999999999999e-06 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515311+0000", 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8142999999999999e-05 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515327+0000", 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5993000000000001e-05 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515355+0000", 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7702999999999999e-05 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515419+0000", 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3849000000000005e-05 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "op must wait for map", 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.515424+0000", 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.383e-06 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.517533+0000", 2024-09-17T16:43:29.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0021093409999999998 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.517614+0000", 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0729000000000006e-05 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.525523+0000", 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0079089090000000004 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.531946+0000", 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064228159999999996 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.533592+0000", 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0016461239999999999 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.533690+0000", 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8252999999999996e-05 2024-09-17T16:43:29.569 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:807 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~475136] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.457620+0000", 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.033268813999999, 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019394886, 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.570 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 807 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.457620+0000", 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.457620+0000", 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.457621+0000", 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.458052+0000", 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00043095200000000002 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.458064+0000", 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2129e-05 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.458071+0000", 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5050000000000004e-06 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463301+0000", 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0052301379999999996 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463416+0000", 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000114893 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464210+0000", 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079383299999999997 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471172+0000", 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0069623209999999996 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.476937+0000", 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057652800000000002 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477015+0000", 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8110999999999998e-05 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.575 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:808 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~507904] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.460524+0000", 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.030365675999999, 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022637039000000001, 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.576 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 808 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.460524+0000", 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.460524+0000", 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.460525+0000", 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0410000000000001e-06 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.461192+0000", 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066739999999999996 2024-09-17T16:43:29.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.461202+0000", 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0166000000000001e-05 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.461210+0000", 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0099999999999995e-06 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.467195+0000", 2024-09-17T16:43:29.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0059850800000000003 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.467290+0000", 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5002999999999998e-05 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.468018+0000", 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00072738800000000004 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471484+0000", 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034666609999999998 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483111+0000", 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011626377 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483161+0000", 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9913000000000001e-05 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.581 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:809 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~475136] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.463552+0000", 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.027336866999999, 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019738499999999999, 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.582 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 809 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463552+0000", 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463552+0000", 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.463553+0000", 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8100000000000001e-07 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464060+0000", 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050633099999999995 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464067+0000", 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5870000000000004e-06 2024-09-17T16:43:29.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464072+0000", 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4989999999999996e-06 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471591+0000", 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0075197079999999999 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.471688+0000", 2024-09-17T16:43:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6704000000000001e-05 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.472440+0000", 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00075215099999999995 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.476728+0000", 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0042878660000000004 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483239+0000", 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0065110039999999999 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483291+0000", 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1669000000000003e-05 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:810 3.es0 3:7ab49360:::smithi18337221-34:head [append 0~98304] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:29.587 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.026782635, 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019486518000000001, 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 810 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464107+0000", 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9699999999999996e-07 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464232+0000", 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000124793 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464243+0000", 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1175999999999999e-05 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464248+0000", 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7790000000000003e-06 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.475401+0000", 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011153450000000001 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.475455+0000", 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3538000000000001e-05 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.475812+0000", 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035700800000000002 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477773+0000", 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0019608109999999998 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483554+0000", 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00578095 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.483593+0000", 2024-09-17T16:43:29.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9415999999999997e-05 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:811 3.es0 3:7ab49360:::smithi18337221-34:head [setxattr _header (57) in=7b] snapc 22=[22,21,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.464259+0000", 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.026629817, 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019819531000000001, 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.593 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 811 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464259+0000", 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464259+0000", 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464260+0000", 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4999999999999998e-07 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464262+0000", 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1280000000000002e-06 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464266+0000", 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0829999999999997e-06 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464271+0000", 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3360000000000002e-06 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477061+0000", 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012790045 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477119+0000", 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.7927999999999998e-05 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477426+0000", 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00030643199999999998 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477916+0000", 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00049028899999999998 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484022+0000", 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061061020000000004 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484079+0000", 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6737999999999998e-05 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.598 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:812 3.es0 3:7ab49360:::smithi18337221-34:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e97)", 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 19.026610602000002, 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.020852448999999999, 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 812 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464279+0000", 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0299999999999999e-07 2024-09-17T16:43:29.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464282+0000", 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4569999999999999e-06 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464288+0000", 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0120000000000002e-06 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.464293+0000", 2024-09-17T16:43:29.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2989999999999996e-06 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477803+0000", 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013510543999999999 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.477904+0000", 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000100907 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484392+0000", 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0064879050000000004 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.484448+0000", 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6224000000000002e-05 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:10.485131+0000", 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00068259799999999997 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.603 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.ds6 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.512841+0000", 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 14.9780485, 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.036902873000000003, 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.512841+0000", 2024-09-17T16:43:29.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.512841+0000", 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.512842+0000", 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.018e-06 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:29.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517597+0000", 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0047555540000000004 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517613+0000", 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5617999999999999e-05 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517622+0000", 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0270000000000001e-06 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517705+0000", 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3067999999999998e-05 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517717+0000", 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.163e-05 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.549709+0000", 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.03199196 2024-09-17T16:43:29.607 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.549744+0000", 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4997999999999999e-05 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:29.608 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:29.609 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:29.610 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:29.606+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:29.610 INFO:tasks.rados.rados.0.smithi183.stdout:399: done (3 left) 2024-09-17T16:43:29.610 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 3 2024-09-17T16:43:29.610 INFO:tasks.rados.rados.0.smithi183.stdout:396: expect (ObjNum 68 snap 10 seq_num 68) 2024-09-17T16:43:29.610 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:29.611 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T16:43:29.612 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:29.612 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is set 2024-09-17T16:43:29.612 INFO:teuthology.orchestra.run.smithi060.stderr:set pool 3 pgp_num to 16 2024-09-17T16:43:29.626 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 1114212 2024-09-17T16:43:29.631 INFO:tasks.rados.rados.0.smithi183.stdout:seeking to 0 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: finishing write tid 1 to smithi18337221-11 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: finishing write tid 2 to smithi18337221-11 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: finishing write tid 3 to smithi18337221-11 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: oid 11 updating version 0 to 257 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: oid 11 updating version 257 to 258 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 11 v 258 (ObjNum 145 snap 40 seq_num 145) dirty exists 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: left oid 11 (ObjNum 145 snap 40 seq_num 145) 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:398: finishing write tid 1 to smithi18337221-44 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:396: done (2 left) 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:397: done (1 left) 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout: waiting on 1 2024-09-17T16:43:29.653 INFO:tasks.rados.rados.0.smithi183.stdout:398: finishing write tid 2 to smithi18337221-44 2024-09-17T16:43:29.654 INFO:tasks.rados.rados.0.smithi183.stdout:398: finishing write tid 3 to smithi18337221-44 2024-09-17T16:43:29.654 INFO:tasks.rados.rados.0.smithi183.stdout:398: oid 44 updating version 0 to 105 2024-09-17T16:43:29.654 INFO:tasks.rados.rados.0.smithi183.stdout:398: oid 44 updating version 105 to 106 2024-09-17T16:43:29.654 INFO:tasks.rados.rados.0.smithi183.stdout:update_object_version oid 44 v 106 (ObjNum 146 snap 40 seq_num 146) dirty exists 2024-09-17T16:43:29.654 INFO:tasks.rados.rados.0.smithi183.stdout:398: left oid 44 (ObjNum 146 snap 40 seq_num 146) 2024-09-17T16:43:29.654 INFO:tasks.rados.rados.0.smithi183.stdout:398: done (0 left) 2024-09-17T16:43:29.655 INFO:tasks.rados.rados.0.smithi183.stderr:0 errors. 2024-09-17T16:43:29.655 INFO:tasks.rados.rados.0.smithi183.stderr: 2024-09-17T16:43:29.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:43:29.710 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:29.708+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:29.755 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:29.755 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:29.755 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:29.755 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:29.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T16:43:29.811 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:29.809+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:29.866 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:29.866 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:29.866 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:29.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T16:43:29.913 INFO:tasks.ceph.osd.1.smithi098.stderr:2024-09-17T16:43:29.909+0000 7f4c830d8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 33042) UID: 0 2024-09-17T16:43:29.959 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:43:29.960 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:43:29.591159+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:43:17.447861+0000","flags":"noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5801984,"flags_set":["noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.9375,"average_primary_affinity":1,"average_primary_affinity_weighted":0.93999999761581421}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T16:41:53.164635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.7300000190734863,"score_stable":3.7300000190734863,"optimal_score":0.67000001668930054,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":0.9375,"average_primary_affinity":1,"average_primary_affinity_weighted":0.93999999761581421}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-09-17T16:42:06.437635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":41,"snap_epoch":116,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":0,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:09.428020+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:43.251994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.553201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.139316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:48.005422+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:47.215991+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.797759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:10.319477+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:51.340953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.967734+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.457055+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:01.609868+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:54.548588+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:42.062460+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:43.675128+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.031579+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[11,4]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":28,"length":1},{"begin":30,"length":1},{"begin":34,"length":1},{"begin":37,"length":3}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":39,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:43:29.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:43:30.013 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:30.011+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 76.522754235999997, 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089069189999999993, 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.018 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492596+0000", 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.492597+0000", 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9700000000000005e-07 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493106+0000", 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00050891100000000002 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493115+0000", 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8079999999999999e-06 2024-09-17T16:43:30.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493123+0000", 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8259999999999993e-06 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493203+0000", 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0124999999999996e-05 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.021 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.493212+0000", 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8340000000000005e-06 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501463+0000", 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0082505530000000007 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:13.501503+0000", 2024-09-17T16:43:30.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9965000000000001e-05 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.503729755999998, 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016927722999999999, 2024-09-17T16:43:30.023 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511620+0000", 2024-09-17T16:43:30.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511621+0000", 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.5900000000000002e-07 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512062+0000", 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044157400000000002 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512083+0000", 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1058999999999999e-05 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512094+0000", 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0559e-05 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512185+0000", 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1187999999999995e-05 2024-09-17T16:43:30.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.512196+0000", 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0668e-05 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528498+0000", 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016302408000000001 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.027 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528548+0000", 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9808000000000002e-05 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 46/34 ECSubWrite(tid=63, reqid=client.4553.0:266, at_version=46'34, trim_to=0'0, roll_forward_to=42'28))", 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.498194065999996, 2024-09-17T16:43:30.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011393616000000001, 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517156+0000", 2024-09-17T16:43:30.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517157+0000", 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4600000000000003e-07 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517245+0000", 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8442999999999993e-05 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517258+0000", 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2527999999999999e-05 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517267+0000", 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1230000000000006e-06 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517400+0000", 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000133015 2024-09-17T16:43:30.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.517409+0000", 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8980000000000002e-06 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528486+0000", 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011077053999999999 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.528550+0000", 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3708999999999996e-05 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 46/34 ECSubWrite(tid=33, reqid=client.4553.0:260, at_version=46'9, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.495222425999998, 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093715889999999996, 2024-09-17T16:43:30.033 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520128+0000", 2024-09-17T16:43:30.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520129+0000", 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0759999999999999e-06 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520297+0000", 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000168049 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520317+0000", 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9792e-05 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520326+0000", 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6269999999999995e-06 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520397+0000", 2024-09-17T16:43:30.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0418000000000002e-05 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.520406+0000", 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5109999999999992e-06 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529445+0000", 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0090386540000000001 2024-09-17T16:43:30.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.529499+0000", 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4462000000000001e-05 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=129, reqid=client.4553.0:353, at_version=55'28, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:43:30.038 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 61.525156942999999, 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01022205, 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490193+0000", 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490194+0000", 2024-09-17T16:43:30.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2330000000000001e-06 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490267+0000", 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2262999999999996e-05 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490279+0000", 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2446000000000001e-05 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490288+0000", 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2560000000000008e-06 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490363+0000", 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4833999999999995e-05 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490371+0000", 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2640000000000008e-06 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500387+0000", 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010015242000000001 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500415+0000", 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8512000000000001e-05 2024-09-17T16:43:30.043 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 55/34 ECSubWrite(tid=130, reqid=client.4553.0:355, at_version=55'30, trim_to=0'0, roll_forward_to=55'24))", 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 61.519043945, 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010886477, 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:43:30.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496306+0000", 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496307+0000", 2024-09-17T16:43:30.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1099999999999995e-07 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496400+0000", 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2985000000000005e-05 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496415+0000", 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4674e-05 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496423+0000", 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2870000000000004e-06 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496478+0000", 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5077999999999997e-05 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.496488+0000", 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0344e-05 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507159+0000", 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010670513 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.507193+0000", 2024-09-17T16:43:30.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3884999999999998e-05 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 56/34 ECSubWrite(tid=108, reqid=client.4553.0:405, at_version=56'72, trim_to=0'0, roll_forward_to=55'70))", 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 60.513197251999998, 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010661874999999999, 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502153+0000", 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502154+0000", 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1999999999999998e-07 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502368+0000", 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000213904 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502383+0000", 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5447999999999998e-05 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502395+0000", 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1589e-05 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502457+0000", 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2644000000000005e-05 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.502467+0000", 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0206e-05 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512759+0000", 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010291234999999999 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:29.512815+0000", 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.6029000000000002e-05 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.057 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=131, reqid=osd.5.0:131, at_version=60'89, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.510148035, 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012770672, 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505202+0000", 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505203+0000", 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.017e-06 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505226+0000", 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3224e-05 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505239+0000", 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2744e-05 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.505248+0000", 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9549999999999998e-06 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507065+0000", 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0018174560000000001 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.061 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.507074+0000", 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6589999999999996e-06 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517937+0000", 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010863268000000001 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.517973+0000", 2024-09-17T16:43:30.062 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5349000000000003e-05 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.es5 60/34 ECSubWrite(tid=145, reqid=osd.2.0:145, at_version=60'47, trim_to=0'0, roll_forward_to=59'43))", 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.501604557999997, 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01010516, 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.063 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.064 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513746+0000", 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.92e-07 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513775+0000", 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8588000000000001e-05 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513792+0000", 2024-09-17T16:43:30.065 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6854000000000002e-05 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513806+0000", 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4683e-05 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515751+0000", 2024-09-17T16:43:30.066 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001944814 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.515778+0000", 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7189999999999999e-05 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523825+0000", 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0080462659999999998 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.067 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523851+0000", 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5973e-05 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs4 60/34 ECSubWrite(tid=138, reqid=client.4553.0:432, at_version=60'91, trim_to=0'0, roll_forward_to=59'85))", 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.501362153000002, 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099123409999999999, 2024-09-17T16:43:30.068 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513988+0000", 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.069 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.513989+0000", 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.82e-07 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514171+0000", 2024-09-17T16:43:30.070 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00018223600000000001 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514183+0000", 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2313999999999999e-05 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514192+0000", 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1849999999999993e-06 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.071 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514282+0000", 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0068999999999994e-05 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.514294+0000", 2024-09-17T16:43:30.072 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.203e-05 2024-09-17T16:43:30.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.073 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.073 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523860+0000", 2024-09-17T16:43:30.073 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095660139999999994 2024-09-17T16:43:30.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.523900+0000", 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9910999999999998e-05 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as5 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:30.074 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 51.559651181, 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015125326, 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.075 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455699+0000", 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.04e-07 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.076 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456064+0000", 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00036538299999999999 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456076+0000", 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.077 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456084+0000", 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7139999999999999e-06 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456157+0000", 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3034000000000006e-05 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.456168+0000", 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0789e-05 2024-09-17T16:43:30.078 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470774+0000", 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014606060000000001 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470824+0000", 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.9960000000000003e-05 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=202, reqid=client.4553.0:547, at_version=72'35, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.565664460000001, 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012786751000000001, 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.080 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449686+0000", 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.081 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449687+0000", 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1939999999999999e-06 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449814+0000", 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012759199999999999 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.082 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449828+0000", 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3566e-05 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.083 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449852+0000", 2024-09-17T16:43:30.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4219999999999999e-05 2024-09-17T16:43:30.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.084 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.084 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.084 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449921+0000", 2024-09-17T16:43:30.084 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8886000000000004e-05 2024-09-17T16:43:30.085 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.085 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.085 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.449931+0000", 2024-09-17T16:43:30.085 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.7529999999999996e-06 2024-09-17T16:43:30.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.086 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.086 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462433+0000", 2024-09-17T16:43:30.086 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012502233 2024-09-17T16:43:30.086 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.087 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.087 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.462472+0000", 2024-09-17T16:43:30.087 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.9307000000000002e-05 2024-09-17T16:43:30.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.088 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.5s6 72/34 ECSubWrite(tid=205, reqid=client.4553.0:548, at_version=72'36, trim_to=0'0, roll_forward_to=63'33))", 2024-09-17T16:43:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:43:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 44.557463429000002, 2024-09-17T16:43:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010065104, 2024-09-17T16:43:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.089 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.090 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457887+0000", 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.457888+0000", 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.04e-06 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458356+0000", 2024-09-17T16:43:30.091 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046822600000000003 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458387+0000", 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0892999999999997e-05 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458397+0000", 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9660000000000008e-06 2024-09-17T16:43:30.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458678+0000", 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028162199999999998 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.458693+0000", 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4616e-05 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.467925+0000", 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092320630000000004 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:45.467952+0000", 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.6678000000000001e-05 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.094 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.529555+0000", 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.485794738999999, 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0095323479999999995, 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529555+0000", 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529555+0000", 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529556+0000", 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0240000000000001e-06 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.096 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529822+0000", 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00026517100000000003 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529846+0000", 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4933999999999999e-05 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529856+0000", 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0009e-05 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529946+0000", 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9624999999999997e-05 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.098 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529956+0000", 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4690000000000003e-06 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539057+0000", 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0091019289999999999 2024-09-17T16:43:30.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539088+0000", 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.0187000000000001e-05 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:30.100 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 24.545630515999999, 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027707544000000001, 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.101 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469720+0000", 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.09e-07 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471119+0000", 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0013988729999999999 2024-09-17T16:43:30.102 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471130+0000", 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1635e-05 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471136+0000", 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1260000000000003e-06 2024-09-17T16:43:30.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471202+0000", 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5477999999999999e-05 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.471214+0000", 2024-09-17T16:43:30.104 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2539e-05 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497409+0000", 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026194978000000001 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497427+0000", 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7805999999999999e-05 2024-09-17T16:43:30.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:09.479040+0000", 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 20.536309747000001, 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019967884000000002, 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479040+0000", 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479040+0000", 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479041+0000", 2024-09-17T16:43:30.107 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8199999999999998e-07 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480758+0000", 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017172870000000001 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480776+0000", 2024-09-17T16:43:30.108 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7574000000000001e-05 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480786+0000", 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.876e-06 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.109 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.110 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480855+0000", 2024-09-17T16:43:30.110 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8683999999999995e-05 2024-09-17T16:43:30.110 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.110 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.110 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.111 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480890+0000", 2024-09-17T16:43:30.111 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5262999999999998e-05 2024-09-17T16:43:30.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.111 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.111 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.498971+0000", 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018081327000000001 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.499008+0000", 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6990999999999999e-05 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 101/34 ECSubWrite(tid=424, reqid=client.4553.0:869, at_version=101'140, trim_to=0'0, roll_forward_to=100'138))", 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.491279+0000", 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.524071502, 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093664879999999992, 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.113 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491279+0000", 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491279+0000", 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491279+0000", 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5099999999999999e-07 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.114 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491798+0000", 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00051852599999999995 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491809+0000", 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0916e-05 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.115 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491815+0000", 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0870000000000003e-06 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491867+0000", 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1870999999999999e-05 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.116 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.491873+0000", 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2280000000000003e-06 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.500608+0000", 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0087345640000000002 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.117 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.500645+0000", 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7545000000000001e-05 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.118 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s1 111/107 ECSubWrite(tid=511, reqid=client.4553.0:925, at_version=111'140, trim_to=0'0, roll_forward_to=110'138))", 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:24.469458+0000", 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.5458919729999998, 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015293446, 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.469458+0000", 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.119 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.469458+0000", 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.469459+0000", 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8700000000000005e-07 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.120 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470279+0000", 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00082011300000000003 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470296+0000", 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7484000000000001e-05 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470305+0000", 2024-09-17T16:43:30.121 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8550000000000008e-06 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470384+0000", 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.8814999999999997e-05 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470393+0000", 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6500000000000002e-06 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.484716+0000", 2024-09-17T16:43:30.122 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014323219999999999 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.484752+0000", 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5522000000000003e-05 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 111/34 ECSubWrite(tid=512, reqid=client.4553.0:928, at_version=111'162, trim_to=0'0, roll_forward_to=110'160))", 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:24.475333+0000", 2024-09-17T16:43:30.123 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 5.5400173309999996, 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011763129000000001, 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475333+0000", 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475333+0000", 2024-09-17T16:43:30.124 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475334+0000", 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6199999999999997e-07 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475474+0000", 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00014073199999999999 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.125 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475487+0000", 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.278e-05 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475497+0000", 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.893e-06 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475558+0000", 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1048000000000002e-05 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.126 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.475568+0000", 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6760000000000002e-06 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.487064+0000", 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011496697 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.487096+0000", 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1541000000000002e-05 2024-09-17T16:43:30.127 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.bs4 112/34 ECSubWrite(tid=522, reqid=client.4553.0:941, at_version=112'167, trim_to=0'0, roll_forward_to=111'165))", 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:25.471137+0000", 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 4.5442135280000002, 2024-09-17T16:43:30.128 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01045505, 2024-09-17T16:43:30.129 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.129 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.129 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.129 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.129 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.129 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.471137+0000", 2024-09-17T16:43:30.130 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.130 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.130 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.130 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.130 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.471137+0000", 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.471137+0000", 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.5199999999999995e-07 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.131 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.471988+0000", 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00085027300000000002 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.472000+0000", 2024-09-17T16:43:30.132 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2422999999999999e-05 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.472008+0000", 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0970000000000006e-06 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.133 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.472069+0000", 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.0557999999999999e-05 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.472082+0000", 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3179999999999999e-05 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.134 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.481538+0000", 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094556210000000009 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:25.481592+0000", 2024-09-17T16:43:30.135 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4045999999999997e-05 2024-09-17T16:43:30.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.136 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.136 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.136 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:30.137 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-09-17T16:43:30.138 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:30.135+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:30.238 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-17T16:43:30.235+0000 7f9302402640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33879) UID: 0 2024-09-17T16:43:30.241 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.242 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:30.242 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:30.242 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:30.253 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-09-17T16:43:30.270 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:43:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:43:30.283 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-17T16:43:29.595596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105644595,"num_objects":67,"num_object_clones":19,"num_object_copies":449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":3,"num_read":527,"num_read_kb":141088,"num_write":1027,"num_write_kb":145560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":186,"num_bytes_recovered":136090163,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1618,"ondisk_log_size":1618,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":738464,"kb_used_data":203288,"kb_used_omap":24,"kb_used_meta":534759,"kb_avail":1509210976,"statfs":{"total":1546188226560,"available":1545432039424,"internally_reserved":0,"allocated":208166912,"data_stored":242096588,"data_compressed":2882915,"data_compressed_allocated":5853184,"data_compressed_original":12611584,"omap_allocated":25521,"internal_metadata":547593295},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3653632,"num_objects":-11,"num_object_clones":-10,"num_object_copies":-77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-11,"num_whiteouts":-1,"num_read":20,"num_read_kb":25307,"num_write":38,"num_write_kb":7840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-3,"num_bytes_recovered":-638976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.142774"},"pg_stats":[{"pgid":"3.f","version":"103'30","reported_seq":215,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.454927+0000","last_change":"2024-09-17T16:43:26.454559+0000","last_active":"2024-09-17T16:43:27.454927+0000","last_peered":"2024-09-17T16:43:27.454927+0000","last_clean":"2024-09-17T16:43:27.454927+0000","last_became_active":"2024-09-17T16:43:24.463619+0000","last_became_peered":"2024-09-17T16:43:24.463619+0000","last_unstale":"2024-09-17T16:43:27.454927+0000","last_undegraded":"2024-09-17T16:43:27.454927+0000","last_fullsized":"2024-09-17T16:43:27.454927+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-17T16:43:25.158716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:25.158716+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:28.885249+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00063768600000000005,"stat_sum":{"num_bytes":638976,"num_objects":1,"num_object_clones":0,"num_object_copies":7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1542,"num_write":24,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":638976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,14,11,7,10,0],"acting":[13,2,14,11,7,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.e","version":"113'164","reported_seq":647,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.467062+0000","last_change":"2024-09-17T16:43:26.454480+0000","last_active":"2024-09-17T16:43:27.467062+0000","last_peered":"2024-09-17T16:43:27.467062+0000","last_clean":"2024-09-17T16:43:27.467062+0000","last_became_active":"2024-09-17T16:43:21.458960+0000","last_became_peered":"2024-09-17T16:43:21.458960+0000","last_unstale":"2024-09-17T16:43:27.467062+0000","last_undegraded":"2024-09-17T16:43:27.467062+0000","last_fullsized":"2024-09-17T16:43:27.467062+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"100'128","last_scrub_stamp":"2024-09-17T16:43:14.235873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:14.235873+0000","objects_scrubbed":9,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:39.829205+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0.000560189,"stat_sum":{"num_bytes":7667712,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":37,"num_read_kb":14688,"num_write":68,"num_write_kb":13840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":10534912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,5,13,8,6,12],"acting":[2,11,5,13,8,6,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.d","version":"111'39","reported_seq":84,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.464453+0000","last_change":"2024-09-17T16:43:25.151730+0000","last_active":"2024-09-17T16:43:25.464453+0000","last_peered":"2024-09-17T16:43:25.464453+0000","last_clean":"2024-09-17T16:43:25.464453+0000","last_became_active":"2024-09-17T16:43:24.464227+0000","last_became_peered":"2024-09-17T16:43:24.464227+0000","last_unstale":"2024-09-17T16:43:25.464453+0000","last_undegraded":"2024-09-17T16:43:25.464453+0000","last_fullsized":"2024-09-17T16:43:25.464453+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"111'39","last_scrub_stamp":"2024-09-17T16:43:25.151576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:25.151576+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:39.720849+0000","scrub_duration":5,"objects_trimmed":1,"snaptrim_duration":0.0067553020000000004,"stat_sum":{"num_bytes":4882432,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":699,"num_write":31,"num_write_kb":5088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":6569984,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,14,10,9,8,4],"acting":[13,1,14,10,9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"3.c","version":"111'239","reported_seq":786,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-17T16:43:24.479187+0000","last_change":"2024-09-17T16:43:23.476813+0000","last_active":"2024-09-17T16:43:24.479187+0000","last_peered":"2024-09-17T16:43:24.479187+0000","last_clean":"2024-09-17T16:43:24.479187+0000","last_became_active":"2024-09-17T16:43:21.458478+0000","last_became_peered":"2024-09-17T16:43:21.458478+0000","last_unstale":"2024-09-17T16:43:24.479187+0000","last_undegraded":"2024-09-17T16:43:24.479187+0000","last_fullsized":"2024-09-17T16:43:24.479187+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:26.681634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.01589815,"stat_sum":{"num_bytes":19316736,"num_objects":11,"num_object_clones":3,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":85,"num_read_kb":25033,"num_write":202,"num_write_kb":22208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,13,10,6,12,3],"acting":[5,8,13,10,6,12,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"3.b","version":"113'169","reported_seq":561,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.453961+0000","last_change":"2024-09-17T16:43:26.467008+0000","last_active":"2024-09-17T16:43:27.453961+0000","last_peered":"2024-09-17T16:43:27.453961+0000","last_clean":"2024-09-17T16:43:27.453961+0000","last_became_active":"2024-09-17T16:42:09.287675+0000","last_became_peered":"2024-09-17T16:42:09.287675+0000","last_unstale":"2024-09-17T16:43:27.453961+0000","last_undegraded":"2024-09-17T16:43:27.453961+0000","last_fullsized":"2024-09-17T16:43:27.453961+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0088823429999999991,"stat_sum":{"num_bytes":14876672,"num_objects":7,"num_object_clones":2,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":10454,"num_write":56,"num_write_kb":20704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,11,12,6,1,7],"acting":[4,0,11,12,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.a","version":"111'81","reported_seq":79,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.465128+0000","last_change":"2024-09-17T16:43:24.470497+0000","last_active":"2024-09-17T16:43:25.465128+0000","last_peered":"2024-09-17T16:43:25.465128+0000","last_clean":"2024-09-17T16:43:25.465128+0000","last_became_active":"2024-09-17T16:43:24.463623+0000","last_became_peered":"2024-09-17T16:43:24.463623+0000","last_unstale":"2024-09-17T16:43:25.465128+0000","last_undegraded":"2024-09-17T16:43:25.465128+0000","last_fullsized":"2024-09-17T16:43:25.465128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:31.970145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050119350000000003,"stat_sum":{"num_bytes":8880128,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":9728,"num_write":49,"num_write_kb":12352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":14352384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,1,7,5,14,6,10],"acting":[13,1,7,5,14,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"3.9","version":"113'68","reported_seq":463,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.460148+0000","last_change":"2024-09-17T16:43:26.460148+0000","last_active":"2024-09-17T16:43:26.460148+0000","last_peered":"2024-09-17T16:43:26.460148+0000","last_clean":"2024-09-17T16:43:26.460148+0000","last_became_active":"2024-09-17T16:42:08.904098+0000","last_became_peered":"2024-09-17T16:42:08.904098+0000","last_unstale":"2024-09-17T16:43:26.460148+0000","last_undegraded":"2024-09-17T16:43:26.460148+0000","last_fullsized":"2024-09-17T16:43:26.460148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'66","last_scrub_stamp":"2024-09-17T16:43:25.718088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:25.718088+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:34.300762+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.0029539700000000002,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":1,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":20,"num_read_kb":5251,"num_write":38,"num_write_kb":3248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,11,0,15,5,8,10],"acting":[14,11,0,15,5,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.8","version":"113'60","reported_seq":463,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.471499+0000","last_change":"2024-09-17T16:43:26.472145+0000","last_active":"2024-09-17T16:43:26.471499+0000","last_peered":"2024-09-17T16:43:26.471499+0000","last_clean":"2024-09-17T16:43:26.471499+0000","last_became_active":"2024-09-17T16:42:09.120152+0000","last_became_peered":"2024-09-17T16:42:09.120152+0000","last_unstale":"2024-09-17T16:43:26.471499+0000","last_undegraded":"2024-09-17T16:43:26.471499+0000","last_fullsized":"2024-09-17T16:43:26.471499+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:43:32.973807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.008617431,"stat_sum":{"num_bytes":1835008,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":8210,"num_write":94,"num_write_kb":4112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2,15,14,1,6],"acting":[11,0,2,15,14,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"1.0","version":"24'92","reported_seq":189,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463399+0000","last_change":"2024-09-17T16:41:46.682932+0000","last_active":"2024-09-17T16:43:26.463399+0000","last_peered":"2024-09-17T16:43:26.463399+0000","last_clean":"2024-09-17T16:43:26.463399+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:43:26.463399+0000","last_undegraded":"2024-09-17T16:43:26.463399+0000","last_fullsized":"2024-09-17T16:43:26.463399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:41:43.656540+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:06.994581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":193,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463057+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:43:26.463057+0000","last_peered":"2024-09-17T16:43:26.463057+0000","last_clean":"2024-09-17T16:43:26.463057+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:43:26.463057+0000","last_undegraded":"2024-09-17T16:43:26.463057+0000","last_fullsized":"2024-09-17T16:43:26.463057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":408,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463369+0000","last_change":"2024-09-17T16:43:26.463749+0000","last_active":"2024-09-17T16:43:26.463369+0000","last_peered":"2024-09-17T16:43:26.463369+0000","last_clean":"2024-09-17T16:43:26.463369+0000","last_became_active":"2024-09-17T16:43:18.466415+0000","last_became_peered":"2024-09-17T16:43:18.466415+0000","last_unstale":"2024-09-17T16:43:26.463369+0000","last_undegraded":"2024-09-17T16:43:26.463369+0000","last_fullsized":"2024-09-17T16:43:26.463369+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066801499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,13,1,5,3,7],"acting":[11,2,13,1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.460894+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:43:26.460894+0000","last_peered":"2024-09-17T16:43:26.460894+0000","last_clean":"2024-09-17T16:43:26.460894+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:43:26.460894+0000","last_undegraded":"2024-09-17T16:43:26.460894+0000","last_fullsized":"2024-09-17T16:43:26.460894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1","version":"110'96","reported_seq":562,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.454080+0000","last_change":"2024-09-17T16:43:26.458681+0000","last_active":"2024-09-17T16:43:27.454080+0000","last_peered":"2024-09-17T16:43:27.454080+0000","last_clean":"2024-09-17T16:43:27.454080+0000","last_became_active":"2024-09-17T16:43:18.465873+0000","last_became_peered":"2024-09-17T16:43:18.465873+0000","last_unstale":"2024-09-17T16:43:27.454080+0000","last_undegraded":"2024-09-17T16:43:27.454080+0000","last_fullsized":"2024-09-17T16:43:27.454080+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:42:07.431491+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063089199999999998,"stat_sum":{"num_bytes":5275648,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":6564,"num_write":68,"num_write_kb":5824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":13828096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,13,3,11,10,2,7],"acting":[4,13,3,11,10,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":182,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.452287+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:43:26.452287+0000","last_peered":"2024-09-17T16:43:26.452287+0000","last_clean":"2024-09-17T16:43:26.452287+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:43:26.452287+0000","last_undegraded":"2024-09-17T16:43:26.452287+0000","last_fullsized":"2024-09-17T16:43:26.452287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"110'82","reported_seq":522,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.457602+0000","last_change":"2024-09-17T16:43:26.457992+0000","last_active":"2024-09-17T16:43:26.457602+0000","last_peered":"2024-09-17T16:43:26.457602+0000","last_clean":"2024-09-17T16:43:26.457602+0000","last_became_active":"2024-09-17T16:43:18.464798+0000","last_became_peered":"2024-09-17T16:43:18.464798+0000","last_unstale":"2024-09-17T16:43:26.457602+0000","last_undegraded":"2024-09-17T16:43:26.457602+0000","last_fullsized":"2024-09-17T16:43:26.457602+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"102'68","last_scrub_stamp":"2024-09-17T16:43:15.695149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:15.695149+0000","objects_scrubbed":6,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:16.734774+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00077978800000000001,"stat_sum":{"num_bytes":8617984,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":2762,"num_write":50,"num_write_kb":8416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":17825792,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2,9,3,13,11,4],"acting":[14,2,9,3,13,11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.2","version":"30'2","reported_seq":104,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.464038+0000","last_change":"2024-09-17T16:43:24.563642+0000","last_active":"2024-09-17T16:43:25.464038+0000","last_peered":"2024-09-17T16:43:25.464038+0000","last_clean":"2024-09-17T16:43:25.464038+0000","last_became_active":"2024-09-17T16:43:24.463168+0000","last_became_peered":"2024-09-17T16:43:24.463168+0000","last_unstale":"2024-09-17T16:43:25.464038+0000","last_undegraded":"2024-09-17T16:43:25.464038+0000","last_fullsized":"2024-09-17T16:43:25.464038+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:41.340854+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,13],"acting":[12,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"3.3","version":"113'72","reported_seq":528,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.460921+0000","last_change":"2024-09-17T16:43:26.453026+0000","last_active":"2024-09-17T16:43:26.460921+0000","last_peered":"2024-09-17T16:43:26.460921+0000","last_clean":"2024-09-17T16:43:26.460921+0000","last_became_active":"2024-09-17T16:43:18.465306+0000","last_became_peered":"2024-09-17T16:43:18.465306+0000","last_unstale":"2024-09-17T16:43:26.460921+0000","last_undegraded":"2024-09-17T16:43:26.460921+0000","last_fullsized":"2024-09-17T16:43:26.460921+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'48","last_scrub_stamp":"2024-09-17T16:43:15.469504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:15.469504+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:23.289468+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00056740800000000004,"stat_sum":{"num_bytes":1327104,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":3202,"num_write":23,"num_write_kb":4912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":8093696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,9,4,13,2,10,5],"acting":[15,9,4,13,2,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"3.5","version":"110'103","reported_seq":494,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-17T16:43:24.461045+0000","last_change":"2024-09-17T16:43:24.004583+0000","last_active":"2024-09-17T16:43:24.461045+0000","last_peered":"2024-09-17T16:43:24.461045+0000","last_clean":"2024-09-17T16:43:24.461045+0000","last_became_active":"2024-09-17T16:42:09.288028+0000","last_became_peered":"2024-09-17T16:42:09.288028+0000","last_unstale":"2024-09-17T16:43:24.461045+0000","last_undegraded":"2024-09-17T16:43:24.461045+0000","last_fullsized":"2024-09-17T16:43:24.461045+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'103","last_scrub_stamp":"2024-09-17T16:43:24.004454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.004454+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:26.122626+0000","scrub_duration":7,"objects_trimmed":2,"snaptrim_duration":0.015587001,"stat_sum":{"num_bytes":6635520,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":7743,"num_write":50,"num_write_kb":8608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,4,9,12,0,6],"acting":[5,8,4,9,12,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"13","length":"1"},{"start":"1a","length":"1"},{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.463052+0000","last_change":"2024-09-17T16:42:45.450049+0000","last_active":"2024-09-17T16:43:26.463052+0000","last_peered":"2024-09-17T16:43:26.463052+0000","last_clean":"2024-09-17T16:43:26.463052+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:43:26.463052+0000","last_undegraded":"2024-09-17T16:43:26.463052+0000","last_fullsized":"2024-09-17T16:43:26.463052+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"110'72","reported_seq":479,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.512178+0000","last_change":"2024-09-17T16:43:26.466663+0000","last_active":"2024-09-17T16:43:27.512178+0000","last_peered":"2024-09-17T16:43:27.512178+0000","last_clean":"2024-09-17T16:43:27.512178+0000","last_became_active":"2024-09-17T16:42:08.818044+0000","last_became_peered":"2024-09-17T16:42:08.818044+0000","last_unstale":"2024-09-17T16:43:27.512178+0000","last_undegraded":"2024-09-17T16:43:27.512178+0000","last_fullsized":"2024-09-17T16:43:27.512178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"110'72","last_scrub_stamp":"2024-09-17T16:43:23.673462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:23.673462+0000","objects_scrubbed":4,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:46.749493+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.0014671479999999999,"stat_sum":{"num_bytes":5062656,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":27,"num_read_kb":15295,"num_write":22,"num_write_kb":5056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4,3,15,14,11],"acting":[8,2,4,3,15,14,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":190,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-17T16:43:25.470579+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:43:25.470579+0000","last_peered":"2024-09-17T16:43:25.470579+0000","last_clean":"2024-09-17T16:43:25.470579+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:43:25.470579+0000","last_undegraded":"2024-09-17T16:43:25.470579+0000","last_fullsized":"2024-09-17T16:43:25.470579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"113'142","reported_seq":616,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.454080+0000","last_change":"2024-09-17T16:43:26.470886+0000","last_active":"2024-09-17T16:43:27.454080+0000","last_peered":"2024-09-17T16:43:27.454080+0000","last_clean":"2024-09-17T16:43:27.454080+0000","last_became_active":"2024-09-17T16:43:21.458094+0000","last_became_peered":"2024-09-17T16:43:21.458094+0000","last_unstale":"2024-09-17T16:43:27.454080+0000","last_undegraded":"2024-09-17T16:43:27.454080+0000","last_fullsized":"2024-09-17T16:43:27.454080+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"101'112","last_scrub_stamp":"2024-09-17T16:43:15.276425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:15.276425+0000","objects_scrubbed":9,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:29.722350+0000","scrub_duration":7,"objects_trimmed":1,"snaptrim_duration":0.012525675999999999,"stat_sum":{"num_bytes":12337152,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":18564,"num_write":85,"num_write_kb":18624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":23871488,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,0,11,10,13],"acting":[4,6,7,0,11,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":185,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-17T16:43:27.507306+0000","last_change":"2024-09-17T16:41:58.095404+0000","last_active":"2024-09-17T16:43:27.507306+0000","last_peered":"2024-09-17T16:43:27.507306+0000","last_clean":"2024-09-17T16:43:27.507306+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:43:27.507306+0000","last_undegraded":"2024-09-17T16:43:27.507306+0000","last_fullsized":"2024-09-17T16:43:27.507306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:05.616046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"110'106","reported_seq":499,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.465052+0000","last_change":"2024-09-17T16:43:26.468430+0000","last_active":"2024-09-17T16:43:26.465052+0000","last_peered":"2024-09-17T16:43:26.465052+0000","last_clean":"2024-09-17T16:43:26.465052+0000","last_became_active":"2024-09-17T16:42:08.901829+0000","last_became_peered":"2024-09-17T16:42:08.901829+0000","last_unstale":"2024-09-17T16:43:26.465052+0000","last_undegraded":"2024-09-17T16:43:26.465052+0000","last_fullsized":"2024-09-17T16:43:26.465052+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"100'88","last_scrub_stamp":"2024-09-17T16:43:14.054959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:42:07.431491+0000","last_clean_scrub_stamp":"2024-09-17T16:43:14.054959+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:43.128595+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0.00369608,"stat_sum":{"num_bytes":7700480,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":11289,"num_write":42,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,15,5,11,9,10],"acting":[0,7,15,5,11,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1c","length":"1"},{"start":"1e","length":"1"},{"start":"22","length":"1"},{"start":"25","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":84,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-17T16:43:26.462693+0000","last_change":"2024-09-17T16:43:24.463572+0000","last_active":"2024-09-17T16:43:26.462693+0000","last_peered":"2024-09-17T16:43:26.462693+0000","last_clean":"2024-09-17T16:43:26.462693+0000","last_became_active":"2024-09-17T16:43:24.463182+0000","last_became_peered":"2024-09-17T16:43:24.463182+0000","last_unstale":"2024-09-17T16:43:26.462693+0000","last_undegraded":"2024-09-17T16:43:26.462693+0000","last_fullsized":"2024-09-17T16:43:26.462693+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:26.377269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":105054208,"num_objects":63,"num_object_clones":19,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":3,"num_read":451,"num_read_kb":141024,"num_write":902,"num_write_kb":143408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":183,"num_bytes_recovered":135561216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":188030976,"data_stored":230379520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1523,"ondisk_log_size":1523,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182425,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":5172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":5296128,"data_stored":5598062,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182425,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39772,"kb_used_data":8576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332068,"statfs":{"total":96636764160,"available":96596037632,"internally_reserved":0,"allocated":8781824,"data_stored":9986728,"data_compressed":178680,"data_compressed_allocated":360448,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182425,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48088,"kb_used_data":16900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323752,"statfs":{"total":96636764160,"available":96587522048,"internally_reserved":0,"allocated":17305600,"data_stored":20214984,"data_compressed":185951,"data_compressed_allocated":393216,"data_compressed_original":1245184,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280535,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43224,"kb_used_data":12032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328616,"statfs":{"total":96636764160,"available":96592502784,"internally_reserved":0,"allocated":12320768,"data_stored":12946286,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280535,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54092,"kb_used_data":22896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94317748,"statfs":{"total":96636764160,"available":96581373952,"internally_reserved":0,"allocated":23445504,"data_stored":28476431,"data_compressed":182795,"data_compressed_allocated":368640,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280535,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":8974336,"data_stored":12414350,"data_compressed":187193,"data_compressed_allocated":397312,"data_compressed_original":1241088,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280535,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46968,"kb_used_data":15776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324872,"statfs":{"total":96636764160,"available":96588668928,"internally_reserved":0,"allocated":16154624,"data_stored":17828718,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313240,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43876,"kb_used_data":12680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327964,"statfs":{"total":96636764160,"available":96591835136,"internally_reserved":0,"allocated":12984320,"data_stored":18859004,"data_compressed":182795,"data_compressed_allocated":368640,"data_compressed_original":737280,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313240,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":8404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":8605696,"data_stored":9538414,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247832,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44032,"kb_used_data":12836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327808,"statfs":{"total":96636764160,"available":96591675392,"internally_reserved":0,"allocated":13144064,"data_stored":14102772,"data_compressed":174567,"data_compressed_allocated":352256,"data_compressed_original":704512,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215126,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":8344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":8544256,"data_stored":8767938,"data_compressed":176623,"data_compressed_allocated":356352,"data_compressed_original":712704,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215129,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":67164,"kb_used_data":17920,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94304676,"statfs":{"total":96636764160,"available":96567988224,"internally_reserved":0,"allocated":18350080,"data_stored":20826562,"data_compressed":176623,"data_compressed_allocated":356352,"data_compressed_original":712704,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215128,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65368,"kb_used_data":16124,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94306472,"statfs":{"total":96636764160,"available":96569827328,"internally_reserved":0,"allocated":16510976,"data_stored":18950594,"data_compressed":176623,"data_compressed_allocated":356352,"data_compressed_original":712704,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215128,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47472,"kb_used_data":12124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324368,"statfs":{"total":96636764160,"available":96588152832,"internally_reserved":0,"allocated":12414976,"data_stored":13480635,"data_compressed":178680,"data_compressed_allocated":360448,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182425,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41984,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329856,"statfs":{"total":96636764160,"available":96593772544,"internally_reserved":0,"allocated":11051008,"data_stored":14842734,"data_compressed":180741,"data_compressed_allocated":364544,"data_compressed_original":729088,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182423,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45136,"kb_used_data":13948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326704,"statfs":{"total":96636764160,"available":96590544896,"internally_reserved":0,"allocated":14282752,"data_stored":15262376,"data_compressed":178680,"data_compressed_allocated":360448,"data_compressed_original":720896,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11005952,"data_stored":11956224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7618560,"data_stored":8163328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8003584,"data_stored":11649024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9736192,"data_stored":13852672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15073280,"data_stored":17428480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11866112,"data_stored":13258752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17424384,"data_stored":20221952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12427264,"data_stored":13254656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":11657216,"data_stored":17858560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":7290880,"data_stored":8548352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":15220736,"data_stored":17981440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16003072,"data_stored":19595264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":11108352,"data_stored":12500992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":22134784,"data_stored":30494720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":7479296,"data_stored":9007104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":3981312,"data_stored":4608000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:43:30.284 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-17T16:43:30.284 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-17T16:43:30.339 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:30.337+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:30.355 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.355 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:30.355 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:30.356 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:30.356 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:30.364 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-09-17T16:43:30.439 INFO:tasks.ceph.osd.5.smithi098.stderr:2024-09-17T16:43:30.437+0000 7faa35e31640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33043) UID: 0 2024-09-17T16:43:30.509 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 46/34 ECSubWrite(tid=32, reqid=client.4553.0:259, at_version=46'8, trim_to=0'0, roll_forward_to=37'6))", 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 70.995467719000004, 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013863510000000001, 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.510 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.511603+0000", 2024-09-17T16:43:30.511 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1000000000000001e-07 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513354+0000", 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001750883 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513367+0000", 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3108999999999999e-05 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.512 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513376+0000", 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.8969999999999997e-06 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513451+0000", 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5122000000000003e-05 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.513461+0000", 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0023999999999999e-05 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.513 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525431+0000", 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011969377 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:19.525467+0000", 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5988000000000002e-05 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.514 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=93, reqid=osd.5.0:93, at_version=55'60, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 62.022070505000002, 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099079770000000001, 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.515 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485000+0000", 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485001+0000", 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.0200000000000003e-07 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485013+0000", 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2393e-05 2024-09-17T16:43:30.516 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485021+0000", 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9230000000000002e-06 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485026+0000", 2024-09-17T16:43:30.517 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0980000000000001e-06 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485078+0000", 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1650999999999997e-05 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.485087+0000", 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9039999999999998e-06 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.518 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494869+0000", 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097825159999999998 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.494908+0000", 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.909e-05 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=94, reqid=osd.5.0:94, at_version=55'62, trim_to=0'0, roll_forward_to=53'58))", 2024-09-17T16:43:30.519 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 62.020494325000001, 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018742894999999999, 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.520 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486577+0000", 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2399999999999997e-07 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486599+0000", 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1361000000000001e-05 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.521 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486608+0000", 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.4609999999999997e-06 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486616+0000", 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.537e-06 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486743+0000", 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000127188 2024-09-17T16:43:30.522 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.486748+0000", 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4489999999999998e-06 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505277+0000", 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018528340000000001 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.505320+0000", 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2834999999999999e-05 2024-09-17T16:43:30.523 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 55/34 ECSubWrite(tid=122, reqid=osd.4.0:119, at_version=0'0, trim_to=0'0, roll_forward_to=55'25))", 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 62.019985792999996, 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013009134, 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.524 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487085+0000", 2024-09-17T16:43:30.525 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487086+0000", 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5099999999999999e-07 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487097+0000", 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1282e-05 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.526 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487113+0000", 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5336e-05 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487121+0000", 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1529999999999997e-06 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487184+0000", 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3207999999999995e-05 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.527 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.487195+0000", 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1467999999999999e-05 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499908+0000", 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012713089 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.500094+0000", 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000185847 2024-09-17T16:43:30.528 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.3s5 55/34 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=55'24, trim_to=0'0, roll_forward_to=53'22))", 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 62.017160666000002, 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010075503, 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.529 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489910+0000", 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1899999999999999e-07 2024-09-17T16:43:30.530 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489931+0000", 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0020000000000001e-05 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489946+0000", 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5729000000000001e-05 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.531 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.489954+0000", 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2549999999999997e-06 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490014+0000", 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9242e-05 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.490024+0000", 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.004e-05 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.532 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499913+0000", 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098893910000000008 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499986+0000", 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2607000000000005e-05 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 55/34 ECSubWrite(tid=95, reqid=client.4553.0:362, at_version=55'64, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:43:30.533 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 62.008187634000002, 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011728341, 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.534 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498883+0000", 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.498884+0000", 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6400000000000001e-07 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499236+0000", 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035160500000000001 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.535 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499249+0000", 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3454e-05 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499256+0000", 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.905e-06 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499318+0000", 2024-09-17T16:43:30.536 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2067000000000001e-05 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.499329+0000", 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1131000000000001e-05 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510579+0000", 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011250135 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.537 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:28.510612+0000", 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2280000000000003e-05 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 56.988498677000003, 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011339162, 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.538 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518572+0000", 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.539 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518573+0000", 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2999999999999999e-07 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518909+0000", 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00033576100000000001 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518925+0000", 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5661000000000001e-05 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.540 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.518933+0000", 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4209999999999995e-06 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519013+0000", 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0346000000000006e-05 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.541 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.519023+0000", 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0212e-05 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529853+0000", 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010829221 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:33.529911+0000", 2024-09-17T16:43:30.542 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8709999999999999e-05 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=158, reqid=client.4553.0:472, at_version=62'104, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.055851574999998, 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016876885000000001, 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.543 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451219+0000", 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451220+0000", 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7499999999999999e-07 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451677+0000", 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045773500000000002 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.545 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451691+0000", 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3679000000000001e-05 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451699+0000", 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0679999999999997e-06 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451773+0000", 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4064000000000001e-05 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.546 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.451783+0000", 2024-09-17T16:43:30.547 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.9259999999999995e-06 2024-09-17T16:43:30.547 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.547 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.547 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468036+0000", 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016253360000000001 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468096+0000", 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.9877999999999998e-05 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.548 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=161, reqid=osd.5.0:161, at_version=62'106, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.049562238999997, 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010613879999999999, 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.549 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.550 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457509+0000", 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.37e-07 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457532+0000", 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2344000000000002e-05 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457542+0000", 2024-09-17T16:43:30.551 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0698e-05 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.457550+0000", 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9289999999999998e-06 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458149+0000", 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00059811399999999996 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.552 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.458387+0000", 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000238247 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468103+0000", 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097161869999999994 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.553 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.468123+0000", 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9624e-05 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 62/34 ECSubWrite(tid=163, reqid=client.4553.0:473, at_version=62'109, trim_to=0'0, roll_forward_to=61'103))", 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 55.046760845000001, 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094236489999999992, 2024-09-17T16:43:30.554 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.555 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460310+0000", 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460311+0000", 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.5899999999999996e-07 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460665+0000", 2024-09-17T16:43:30.556 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00035421500000000001 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460681+0000", 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5739e-05 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.460689+0000", 2024-09-17T16:43:30.557 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3340000000000002e-06 2024-09-17T16:43:30.558 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.558 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.558 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.558 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464005+0000", 2024-09-17T16:43:30.558 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033161390000000001 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.464015+0000", 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0242e-05 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.559 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469702+0000", 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0056865780000000003 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:35.469734+0000", 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1843e-05 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.560 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as6 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.052777485, 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013750108, 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.561 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454293+0000", 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.562 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454294+0000", 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6e-07 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455109+0000", 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00081548199999999997 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455123+0000", 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4392999999999999e-05 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.563 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455130+0000", 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6800000000000004e-06 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455201+0000", 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1088999999999996e-05 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455214+0000", 2024-09-17T16:43:30.564 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2923e-05 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.467980+0000", 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012766136000000001 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.468044+0000", 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3244999999999995e-05 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.565 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.cs3 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.045365590999999, 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0098962259999999993, 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.566 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461705+0000", 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461706+0000", 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7800000000000001e-07 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.567 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461987+0000", 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00028039999999999999 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.461998+0000", 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1080000000000001e-05 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.568 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462005+0000", 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3799999999999996e-06 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462079+0000", 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3937999999999996e-05 2024-09-17T16:43:30.569 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.462087+0000", 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1270000000000003e-06 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.471578+0000", 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0094905340000000001 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.471602+0000", 2024-09-17T16:43:30.570 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3989e-05 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 86/77 ECSubWrite(tid=314, reqid=client.4553.0:694, at_version=86'68, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.521724+0000", 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.985346529000001, 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014249914000000001, 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.571 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521724+0000", 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521724+0000", 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521725+0000", 2024-09-17T16:43:30.572 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.1800000000000002e-07 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522508+0000", 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078327500000000005 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522533+0000", 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4638e-05 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.573 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522547+0000", 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4154e-05 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522643+0000", 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.5835000000000007e-05 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522654+0000", 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1477e-05 2024-09-17T16:43:30.574 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.535936+0000", 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013282001 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.535974+0000", 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.8216000000000001e-05 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.575 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 86/77 ECSubWrite(tid=315, reqid=client.4553.0:695, at_version=86'69, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.529803+0000", 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 30.977268255999999, 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097265939999999999, 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529803+0000", 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.576 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529803+0000", 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.529805+0000", 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.968e-06 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530434+0000", 2024-09-17T16:43:30.577 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00062917400000000003 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530453+0000", 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9321999999999999e-05 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530464+0000", 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0380000000000001e-05 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.578 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530577+0000", 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00011335199999999999 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.530593+0000", 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5688999999999998e-05 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.579 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539494+0000", 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0089014420000000007 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539529+0000", 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5267e-05 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:30.580 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:05.469888+0000", 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.037183184, 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017642463000000001, 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469888+0000", 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.581 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469888+0000", 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469889+0000", 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.33e-07 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.582 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472597+0000", 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00270783 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472621+0000", 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.4241999999999999e-05 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472633+0000", 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.253e-05 2024-09-17T16:43:30.583 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472704+0000", 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.0591000000000002e-05 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472715+0000", 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1457999999999999e-05 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.584 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.487488+0000", 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014772815999999999 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.487530+0000", 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.2063e-05 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.1s4 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:30.585 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:09.465227+0000", 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.041844147999999, 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012452022, 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465227+0000", 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.586 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465227+0000", 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465227+0000", 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.8599999999999998e-07 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465788+0000", 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000560857 2024-09-17T16:43:30.587 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465802+0000", 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3169999999999999e-05 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465809+0000", 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7880000000000007e-06 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.588 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465872+0000", 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3082000000000004e-05 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.465886+0000", 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3905e-05 2024-09-17T16:43:30.589 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.477645+0000", 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011759042000000001 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.477679+0000", 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3491999999999997e-05 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.590 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:09.479377+0000", 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.027693754000001, 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017961784000000001, 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.591 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479377+0000", 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479377+0000", 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.592 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479378+0000", 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4600000000000004e-07 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480797+0000", 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014189669999999999 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.593 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480810+0000", 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3383e-05 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480819+0000", 2024-09-17T16:43:30.594 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4950000000000008e-06 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480903+0000", 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3844000000000006e-05 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.480914+0000", 2024-09-17T16:43:30.595 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1229e-05 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.497304+0000", 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016389887999999998 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.596 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.497339+0000", 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5332e-05 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 101/77 ECSubWrite(tid=423, reqid=client.4553.0:857, at_version=101'110, trim_to=0'0, roll_forward_to=101'108))", 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.489403+0000", 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.017668333, 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0097292569999999998, 2024-09-17T16:43:30.597 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489403+0000", 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489403+0000", 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.598 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489403+0000", 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1699999999999997e-07 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489703+0000", 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00029996500000000002 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489717+0000", 2024-09-17T16:43:30.599 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3179999999999999e-05 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489723+0000", 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6209999999999998e-06 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489776+0000", 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.3266999999999997e-05 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.600 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.489783+0000", 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3409999999999999e-06 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.499096+0000", 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0093135500000000003 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.601 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.499132+0000", 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.5515999999999997e-05 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.ds3 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.513114+0000", 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 15.993957238, 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.033774125000000002, 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.602 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513114+0000", 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513114+0000", 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.603 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513115+0000", 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0750000000000001e-06 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517106+0000", 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0039908000000000001 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517124+0000", 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8474999999999998e-05 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.604 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517132+0000", 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.0819999999999999e-06 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517204+0000", 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1905999999999999e-05 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517217+0000", 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.309e-05 2024-09-17T16:43:30.605 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.546841+0000", 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.029623591000000001 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.546888+0000", 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.7105999999999999e-05 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.606 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s5 111/107 ECSubWrite(tid=511, reqid=client.4553.0:925, at_version=111'140, trim_to=0'0, roll_forward_to=110'138))", 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:24.470240+0000", 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 6.0368307430000003, 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015873660000000001, 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470240+0000", 2024-09-17T16:43:30.607 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470240+0000", 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.470240+0000", 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.03e-07 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.608 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.471716+0000", 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001475121 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.471727+0000", 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1073999999999999e-05 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.471738+0000", 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1639e-05 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.609 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.471802+0000", 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3899000000000006e-05 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.471814+0000", 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1446e-05 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.486085+0000", 2024-09-17T16:43:30.610 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01427138 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:24.486114+0000", 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8798000000000001e-05 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.611 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:30.613 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-09-17T16:43:30.613 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:30.610+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:30.714 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:30.712+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:30.717 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:30.718 INFO:teuthology.orchestra.run.smithi111.stdout: "num_ops": 0 2024-09-17T16:43:30.718 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:30.726 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-09-17T16:43:30.814 INFO:tasks.ceph.osd.7.smithi183.stderr:2024-09-17T16:43:30.813+0000 7f953b4e9640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33513) UID: 0 2024-09-17T16:43:30.829 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.829 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [], 2024-09-17T16:43:30.829 INFO:teuthology.orchestra.run.smithi111.stdout: "complaint_time": 30, 2024-09-17T16:43:30.829 INFO:teuthology.orchestra.run.smithi111.stdout: "num_blocked_ops": 0 2024-09-17T16:43:30.829 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:30.837 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-09-17T16:43:30.915 INFO:tasks.ceph.osd.10.smithi111.stderr:2024-09-17T16:43:30.913+0000 7ff255ea6640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 32990) UID: 0 2024-09-17T16:43:30.942 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-17T16:43:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 20, 2024-09-17T16:43:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 600, 2024-09-17T16:43:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: "ops": [ 2024-09-17T16:43:30.942 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:252 3.9s0 3:97a3b59a:::smithi18337221-19:head [append 0~376832] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.432036127999993, 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014876686, 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 252 2024-09-17T16:43:30.943 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507155+0000", 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.944 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507156+0000", 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2309999999999999e-06 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507825+0000", 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00066852899999999995 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.945 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507839+0000", 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4260999999999999e-05 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507848+0000", 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9660000000000002e-06 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.946 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513602+0000", 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0057539069999999999 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.513711+0000", 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010927199999999999 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.514507+0000", 2024-09-17T16:43:30.947 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079574400000000003 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518107+0000", 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0035998129999999999 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.521980+0000", 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038731780000000001 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.948 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522032+0000", 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.1785e-05 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:253 3.9s0 3:97a3b59a:::smithi18337221-19:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:43:30.949 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.431319461000001, 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01439824, 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 253 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:43:30.950 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507872+0000", 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507873+0000", 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1319999999999999e-06 2024-09-17T16:43:30.951 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.952 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507897+0000", 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.44e-05 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507905+0000", 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9980000000000003e-06 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.953 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507913+0000", 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2849999999999997e-06 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517178+0000", 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0092654350000000007 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517280+0000", 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000102011 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.954 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.517762+0000", 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048150100000000001 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518681+0000", 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00091987099999999995 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522146+0000", 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003464895 2024-09-17T16:43:30.955 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522270+0000", 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000123712 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.956 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:254 3.9s0 3:97a3b59a:::smithi18337221-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e45)", 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 72.431266816999994, 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014640482, 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.957 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 254 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507924+0000", 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.958 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507925+0000", 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.4700000000000001e-07 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507927+0000", 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0789999999999999e-06 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507932+0000", 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.8400000000000002e-06 2024-09-17T16:43:30.959 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.507935+0000", 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3380000000000001e-06 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518013+0000", 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010077697 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:30.960 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.518096+0000", 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2707000000000006e-05 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522552+0000", 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044558430000000001 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:18.522565+0000", 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3431000000000001e-05 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.961 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.as4 65/34 ECSubWrite(tid=69, reqid=client.4553.0:501, at_version=65'27, trim_to=0'0, roll_forward_to=62'25))", 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 52.484880824999998, 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016135330999999999, 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.962 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454310+0000", 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454311+0000", 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4900000000000001e-07 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.963 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454926+0000", 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00061552000000000004 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454943+0000", 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6433999999999999e-05 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.454970+0000", 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7345999999999999e-05 2024-09-17T16:43:30.964 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455041+0000", 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.1317999999999997e-05 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.455050+0000", 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.4160000000000004e-06 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470410+0000", 2024-09-17T16:43:30.965 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015359937000000001 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:38.470446+0000", 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.6010999999999998e-05 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.966 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:655 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~655360] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.653310+0000", 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.285881142999997, 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018562510000000001, 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.967 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 655 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653310+0000", 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653310+0000", 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.968 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653312+0000", 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.2630000000000002e-06 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.653983+0000", 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00067078999999999999 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.969 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654005+0000", 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.1562000000000001e-05 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654014+0000", 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2129999999999997e-06 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.970 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654076+0000", 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1883000000000004e-05 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654150+0000", 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4365999999999999e-05 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.654845+0000", 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00069466000000000005 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.971 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.665740+0000", 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010895414000000001 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671790+0000", 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0060495820000000004 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671873+0000", 2024-09-17T16:43:30.972 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.2776999999999997e-05 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:656 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~606208] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.656634+0000", 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.282557134999998, 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017061376, 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.973 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 656 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.656634+0000", 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.656634+0000", 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.974 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.656635+0000", 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2640000000000001e-06 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.657191+0000", 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00055534099999999999 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.975 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.657203+0000", 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2454e-05 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.657209+0000", 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.8420000000000001e-06 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.661005+0000", 2024-09-17T16:43:30.976 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00379612 2024-09-17T16:43:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.977 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.661128+0000", 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000122855 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.661911+0000", 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00078326000000000003 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671895+0000", 2024-09-17T16:43:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0099834620000000002 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673651+0000", 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0017562140000000001 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673696+0000", 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.4564000000000002e-05 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.979 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:657 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~475136] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.659429+0000", 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.279762097000003, 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.015975145999999999, 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.980 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 657 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659429+0000", 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659429+0000", 2024-09-17T16:43:30.981 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659430+0000", 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2999999999999999e-07 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659803+0000", 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00037236799999999998 2024-09-17T16:43:30.982 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659814+0000", 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1783999999999999e-05 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659820+0000", 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.857e-06 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.983 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.665923+0000", 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0061033019999999997 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.666011+0000", 2024-09-17T16:43:30.984 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7272000000000001e-05 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.666850+0000", 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00083894199999999996 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.671986+0000", 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0051360570000000003 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.985 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.675363+0000", 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0033769749999999999 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.675404+0000", 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.1659000000000002e-05 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.986 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:658 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~81920] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.659899+0000", 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.279291847000003, 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016684350000000001, 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 658 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.987 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659899+0000", 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659899+0000", 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.988 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659900+0000", 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1699999999999997e-07 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659975+0000", 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.4841999999999999e-05 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659983+0000", 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.6769999999999995e-06 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.989 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659986+0000", 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.7050000000000001e-06 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.670389+0000", 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.010402575000000001 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.670497+0000", 2024-09-17T16:43:30.990 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000107958 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.670978+0000", 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00048103099999999998 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672041+0000", 2024-09-17T16:43:30.991 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010632300000000001 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676446+0000", 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0044043939999999998 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676584+0000", 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000138121 2024-09-17T16:43:30.992 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:659 3.0s0 3:0cb75d13:::smithi18337221-6:head [setxattr _header (56) in=7b] snapc 1b=[1b,1a,19,18,14,13,f] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.659994+0000", 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.279196827, 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.016805785, 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:30.993 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 659 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:30.994 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659994+0000", 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659994+0000", 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:30.995 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659995+0000", 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.08e-07 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.659997+0000", 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.7120000000000001e-06 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660001+0000", 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.3270000000000002e-06 2024-09-17T16:43:30.996 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660004+0000", 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.729e-06 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672198+0000", 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012194023 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.997 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672284+0000", 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.6810000000000004e-05 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.672696+0000", 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000411884 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:30.998 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673300+0000", 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.000604121 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676707+0000", 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0034068530000000001 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.676800+0000", 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2917999999999994e-05 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:30.999 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:660 3.0s0 3:0cb75d13:::smithi18337221-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e82)", 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:55.660007+0000", 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 35.279183840000002, 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017680199000000001, 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.000 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 660 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660007+0000", 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660007+0000", 2024-09-17T16:43:31.001 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660008+0000", 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.5699999999999999e-07 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.002 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660009+0000", 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.331e-06 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660013+0000", 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.4999999999999999e-06 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.003 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.660015+0000", 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.7219999999999999e-06 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673337+0000", 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013321665999999999 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.004 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.673428+0000", 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.1176999999999998e-05 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.677183+0000", 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.003754715 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.005 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.677236+0000", 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.287e-05 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:55.677688+0000", 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00045196100000000002 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s6 86/77 ECSubWrite(tid=314, reqid=client.4553.0:694, at_version=86'68, trim_to=0'0, roll_forward_to=85'67))", 2024-09-17T16:43:31.006 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:42:59.521686+0000", 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 31.417504991000001, 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.018258262000000001, 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521686+0000", 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.007 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521686+0000", 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.521687+0000", 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.1900000000000001e-07 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522744+0000", 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0010568439999999999 2024-09-17T16:43:31.008 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522764+0000", 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.9545e-05 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522773+0000", 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.6700000000000006e-06 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.009 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522863+0000", 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0087000000000007e-05 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.522874+0000", 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0761000000000001e-05 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539894+0000", 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017019854000000001 2024-09-17T16:43:31.010 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:42:59.539945+0000", 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0682e-05 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s6 92/77 ECSubWrite(tid=334, reqid=client.4553.0:722, at_version=92'77, trim_to=0'0, roll_forward_to=91'75))", 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:05.469892+0000", 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 25.469298898000002, 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.027143515, 2024-09-17T16:43:31.011 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469892+0000", 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469892+0000", 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.012 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.469893+0000", 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.7800000000000001e-07 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472671+0000", 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002778151 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.013 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472692+0000", 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.0194999999999999e-05 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472701+0000", 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.3000000000000007e-06 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472774+0000", 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.2841000000000003e-05 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.014 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.472786+0000", 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.2362e-05 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497002+0000", 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.024216044999999999 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:05.497036+0000", 2024-09-17T16:43:31.015 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.3843000000000001e-05 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.7s6 96/77 ECSubWrite(tid=375, reqid=client.4553.0:789, at_version=96'92, trim_to=0'0, roll_forward_to=96'90))", 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:09.479842+0000", 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 21.459349508999999, 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.019586619, 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.016 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479842+0000", 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479842+0000", 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.017 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.479843+0000", 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.92e-07 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481704+0000", 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001861779 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481719+0000", 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4143e-05 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.018 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481726+0000", 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.9470000000000003e-06 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481793+0000", 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7001000000000004e-05 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.481803+0000", 2024-09-17T16:43:31.019 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.8980000000000008e-06 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.499400+0000", 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.01759635 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:09.499428+0000", 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.8708999999999999e-05 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.020 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:876 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~671744] snapc 24=[23,22,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.506790+0000", 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.432400879999999, 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.026108292000000002, 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.021 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 876 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.506790+0000", 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.506790+0000", 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.022 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.506792+0000", 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.8640000000000001e-06 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.507511+0000", 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00071858800000000004 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.507524+0000", 2024-09-17T16:43:31.023 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.3508e-05 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.507531+0000", 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1619999999999996e-06 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.507581+0000", 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.0469000000000001e-05 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.024 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.507656+0000", 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.5118999999999997e-05 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.508765+0000", 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0011092859999999999 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.025 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520006+0000", 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011240449 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.532775+0000", 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012769298 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.532899+0000", 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00012354900000000001 2024-09-17T16:43:31.026 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:877 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~573440] snapc 24=[23,22,1e,1c,1a,13] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.510260+0000", 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.42893097, 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.022789009999999998, 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.027 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 877 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.510260+0000", 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.510260+0000", 2024-09-17T16:43:31.028 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.510261+0000", 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.111e-06 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.510787+0000", 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00052598800000000002 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.029 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.510803+0000", 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.5395000000000001e-05 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.510812+0000", 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.7730000000000005e-06 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513456+0000", 2024-09-17T16:43:31.030 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.002644197 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513547+0000", 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0933999999999994e-05 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.514501+0000", 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00095385000000000001 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.031 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520503+0000", 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.006002467 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.532976+0000", 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012472769999999999 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.533049+0000", 2024-09-17T16:43:31.032 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 7.3524999999999998e-05 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "MOSDECSubOpWrite(3.ds2 101/77 ECSubWrite(tid=429, reqid=client.4553.0:871, at_version=101'21, trim_to=0'0, roll_forward_to=95'20))", 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.513868+0000", 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.425323702, 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.034366875999999998, 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.033 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513868+0000", 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513868+0000", 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.034 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.513868+0000", 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.5899999999999996e-07 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517679+0000", 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0038112350000000001 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517696+0000", 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.6558999999999998e-05 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.035 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517704+0000", 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.3389999999999993e-06 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517768+0000", 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.3732999999999994e-05 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.517780+0000", 2024-09-17T16:43:31.036 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1836e-05 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.548205+0000", 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.030425243000000001 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.548234+0000", 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.9272e-05 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.037 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:876 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~671744] snapc 24=[23,22,1e,1c,1a,13] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.518444+0000", 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.420747672000001, 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014345115, 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "waiting for ondisk", 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.038 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 876 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.518444+0000", 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.518444+0000", 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.039 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.518445+0000", 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.4300000000000001e-06 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.519329+0000", 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00088389399999999998 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.040 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.519340+0000", 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.0761000000000001e-05 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.519346+0000", 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.6590000000000001e-06 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520572+0000", 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0012255250000000001 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.041 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for ondisk", 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520663+0000", 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0889000000000003e-05 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.532789+0000", 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012125957 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.042 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:878 3.0s0 3:0cb75d13:::smithi18337221-6:head [append 0~753664] snapc 24=[23,22,1e,1c,1a,13] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.519884+0000", 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.419307773, 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014780368, 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 878 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.043 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.519884+0000", 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.519884+0000", 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.044 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.519884+0000", 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7999999999999995e-07 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520616+0000", 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00073205899999999996 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520627+0000", 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 1.1082e-05 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.045 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520634+0000", 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.9659999999999999e-06 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520859+0000", 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00022477700000000001 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520967+0000", 2024-09-17T16:43:31.046 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00010757 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.521966+0000", 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00099896399999999997 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.533062+0000", 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.011096408 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.047 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.534494+0000", 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0014315249999999999 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.534664+0000", 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00017033700000000001 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.048 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:880 3.0s0 3:0cb75d13:::smithi18337221-6:head [setxattr _header (56) in=7b] snapc 24=[23,22,1e,1c,1a,13] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.520770+0000", 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.418421699, 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.014473203, 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 880 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.049 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520770+0000", 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520770+0000", 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520770+0000", 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.4499999999999997e-07 2024-09-17T16:43:31.050 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520774+0000", 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 3.2669999999999998e-06 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520780+0000", 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.2360000000000001e-06 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520785+0000", 2024-09-17T16:43:31.051 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2800000000000003e-06 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.533375+0000", 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.012589555000000001 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.533467+0000", 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.2280000000000004e-05 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.052 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.533934+0000", 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00046702400000000002 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.534730+0000", 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00079617999999999996 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "commit_sent", 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.535176+0000", 2024-09-17T16:43:31.053 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.00044559100000000001 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.535243+0000", 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.7144999999999995e-05 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "description": "osd_op(client.4553.0:881 3.0s0 3:0cb75d13:::smithi18337221-6:head [read 0~1] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e101)", 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "initiated_at": "2024-09-17T16:43:14.520793+0000", 2024-09-17T16:43:31.054 INFO:teuthology.orchestra.run.smithi111.stdout: "age": 16.418398652, 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.017019375, 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "continuous": false, 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "type_data": { 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "flag_point": "started", 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client_info": { 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client": "client.4553", 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "client_addr": "172.21.15.183:0/956970824", 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "tid": 881 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "events": [ 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "initiated", 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520793+0000", 2024-09-17T16:43:31.055 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "header_read", 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520793+0000", 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "throttled", 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520793+0000", 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 4.6400000000000003e-07 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.056 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "all_read", 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520795+0000", 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 2.3089999999999998e-06 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "dispatched", 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520802+0000", 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 6.1809999999999998e-06 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.520807+0000", 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 5.2499999999999997e-06 2024-09-17T16:43:31.057 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.534247+0000", 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.013440283000000001 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "waiting for rw locks", 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.534337+0000", 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 8.9703999999999994e-05 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "reached_pg", 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.535657+0000", 2024-09-17T16:43:31.058 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.001319869 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "started", 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.535747+0000", 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 9.0599000000000005e-05 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "event": "done", 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "time": "2024-09-17T16:43:14.537812+0000", 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: "duration": 0.0020647159999999999 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.059 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-17T16:43:31.060 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-17T16:43:31.060 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-17T16:43:31.061 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T16:43:31.062 INFO:tasks.ceph.osd.12.smithi060.stderr:2024-09-17T16:43:31.059+0000 7faf46ccb640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 33887) UID: 0 2024-09-17T16:43:31.162 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-09-17T16:43:31.160+0000 7f6029cfa640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 32986) UID: 0 2024-09-17T16:43:31.178 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:31.178 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:31.178 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:31.178 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:31.187 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T16:43:31.263 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-17T16:43:31.261+0000 7f5ed99bd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32985) UID: 0 2024-09-17T16:43:31.290 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:31.290 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:31.290 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:31.290 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:31.290 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:31.299 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T16:43:31.364 INFO:tasks.ceph.osd.9.smithi098.stderr:2024-09-17T16:43:31.362+0000 7f378ccf8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 33048) UID: 0 2024-09-17T16:43:31.403 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "size": 20, 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 600, 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [ 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=48, reqid=client.4553.0:190, at_version=40'20, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 77.918407375000001, 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074612999999999997, 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.404 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482438+0000", 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.405 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482439+0000", 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7199999999999998e-07 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482462+0000", 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2668e-05 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482473+0000", 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1354e-05 2024-09-17T16:43:31.406 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.482481+0000", 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6130000000000004e-06 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486671+0000", 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0041899479999999998 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.407 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.486680+0000", 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.8869999999999998e-06 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489834+0000", 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031540069999999999 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.489899+0000", 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.5050999999999998e-05 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.408 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=49, reqid=client.4553.0:191, at_version=40'21, trim_to=0'0, roll_forward_to=37'17))", 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 77.917697339, 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.008086981, 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.409 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483148+0000", 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483149+0000", 2024-09-17T16:43:31.410 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.2900000000000003e-07 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483164+0000", 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.523e-05 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483175+0000", 2024-09-17T16:43:31.411 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0876999999999999e-05 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.483181+0000", 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.3029999999999996e-06 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488038+0000", 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0048566149999999999 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.412 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.488047+0000", 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3070000000000008e-06 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491189+0000", 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0031416790000000001 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.491235+0000", 2024-09-17T16:43:31.413 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.6241e-05 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 40/34 ECSubWrite(tid=50, reqid=client.4553.0:192, at_version=40'23, trim_to=0'0, roll_forward_to=40'20))", 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 77.908258627999999, 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013185944, 2024-09-17T16:43:31.414 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492587+0000", 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.492588+0000", 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7600000000000006e-07 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493009+0000", 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00042131299999999998 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.416 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493025+0000", 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.5605000000000001e-05 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493033+0000", 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.32e-06 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493114+0000", 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.1038000000000006e-05 2024-09-17T16:43:31.417 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.493124+0000", 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4909999999999994e-06 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505727+0000", 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012603346 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505773+0000", 2024-09-17T16:43:31.418 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.5855000000000001e-05 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 40/34 ECSubWrite(tid=25, reqid=client.4553.0:218, at_version=40'8, trim_to=0'0, roll_forward_to=37'5))", 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 77.902309665999994, 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071885259999999998, 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.419 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.420 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498536+0000", 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498537+0000", 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.421 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498559+0000", 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2444000000000001e-05 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498576+0000", 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7067000000000001e-05 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.422 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498585+0000", 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0920000000000004e-06 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498675+0000", 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9314999999999994e-05 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.423 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.498682+0000", 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8699999999999992e-06 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505669+0000", 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069863959999999998 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.424 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:13.505724+0000", 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.5414999999999997e-05 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/34 ECSubWrite(tid=96, reqid=client.4553.0:363, at_version=55'65, trim_to=0'0, roll_forward_to=55'60))", 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 62.896043726000002, 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0083741470000000002, 2024-09-17T16:43:31.425 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.426 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504802+0000", 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.504803+0000", 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.9100000000000002e-07 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.427 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505695+0000", 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00089272400000000001 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505712+0000", 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6320999999999998e-05 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.428 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505720+0000", 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6780000000000006e-06 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505787+0000", 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.6303000000000005e-05 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.429 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.505797+0000", 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0455000000000001e-05 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513105+0000", 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.007307717 2024-09-17T16:43:31.430 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:28.513176+0000", 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.1057999999999996e-05 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.431 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=147, reqid=client.4553.0:433, at_version=60'19, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.882457086999999, 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.016246389999999999, 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.432 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518388+0000", 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.433 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518389+0000", 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.51e-07 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.518980+0000", 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00059100999999999999 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.434 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519003+0000", 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2819999999999998e-05 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519012+0000", 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.8439999999999993e-06 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519183+0000", 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00017095399999999999 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.435 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.519194+0000", 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.102e-05 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534599+0000", 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015404927000000001 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534635+0000", 2024-09-17T16:43:31.436 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5364000000000002e-05 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 60/34 ECSubWrite(tid=150, reqid=client.4553.0:434, at_version=60'20, trim_to=0'0, roll_forward_to=55'17))", 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 57.874721717, 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0085642229999999993, 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.437 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526124+0000", 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.438 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526125+0000", 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2299999999999999e-07 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526311+0000", 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00018657999999999999 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526341+0000", 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9788999999999999e-05 2024-09-17T16:43:31.439 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.526352+0000", 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1379999999999999e-05 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527177+0000", 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00082429900000000002 2024-09-17T16:43:31.440 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.527187+0000", 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.06e-05 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534665+0000", 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0074776570000000004 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.441 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:33.534688+0000", 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.2994999999999999e-05 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=150, reqid=osd.5.0:150, at_version=61'95, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 56.890225118000004, 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071525119999999998, 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.442 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510620+0000", 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.443 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510621+0000", 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4099999999999997e-07 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510647+0000", 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.5749999999999999e-05 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.444 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510664+0000", 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7388999999999999e-05 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510674+0000", 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0011e-05 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510769+0000", 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.4370999999999995e-05 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.445 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.510779+0000", 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0302999999999999e-05 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517731+0000", 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0069523679999999996 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.517773+0000", 2024-09-17T16:43:31.446 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.1378999999999998e-05 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 61/34 ECSubWrite(tid=151, reqid=client.4553.0:467, at_version=61'97, trim_to=0'0, roll_forward_to=60'91))", 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 56.887914575000003, 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0096697429999999997, 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.447 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512931+0000", 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512932+0000", 2024-09-17T16:43:31.448 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2699999999999998e-07 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512962+0000", 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0382000000000002e-05 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512978+0000", 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6013000000000001e-05 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.449 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.512997+0000", 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8839999999999999e-05 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513153+0000", 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000155969 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.450 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.513163+0000", 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.031e-05 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522566+0000", 2024-09-17T16:43:31.451 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094027599999999996 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:34.522601+0000", 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4542000000000002e-05 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=259, reqid=client.4553.0:633, at_version=82'165, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:31.452 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.944527710000003, 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.017286182000000001, 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.453 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.456318+0000", 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0900000000000001e-07 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457450+0000", 2024-09-17T16:43:31.454 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0011316200000000001 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457466+0000", 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6240999999999999e-05 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457479+0000", 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2836e-05 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.455 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457584+0000", 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000105493 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.457594+0000", 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6059999999999992e-06 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473552+0000", 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.015957846000000001 2024-09-17T16:43:31.456 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473604+0000", 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.2330999999999998e-05 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=260, reqid=client.4553.0:634, at_version=82'166, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:31.457 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.939450745000002, 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.012610367000000001, 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461395+0000", 2024-09-17T16:43:31.458 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461396+0000", 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6500000000000008e-07 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461793+0000", 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039774400000000001 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.459 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461808+0000", 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4939999999999999e-05 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.461849+0000", 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0674999999999999e-05 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.462239+0000", 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00038960600000000002 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.460 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.462251+0000", 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2116999999999999e-05 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.473961+0000", 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011710010999999999 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474005+0000", 2024-09-17T16:43:31.461 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.4308999999999999e-05 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.cs6 82/80 ECSubWrite(tid=261, reqid=client.4553.0:635, at_version=82'167, trim_to=0'0, roll_forward_to=81'163))", 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.934643356999999, 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0079189910000000002, 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.462 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466202+0000", 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.463 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466203+0000", 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.291e-06 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466601+0000", 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00039756699999999998 2024-09-17T16:43:31.464 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466621+0000", 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0288999999999998e-05 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.466656+0000", 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.4671000000000001e-05 2024-09-17T16:43:31.465 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.468123+0000", 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0014669419999999999 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.468133+0000", 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.6849999999999996e-06 2024-09-17T16:43:31.466 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474092+0000", 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.005959509 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.474121+0000", 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.9037e-05 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.467 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.0s3 82/77 ECSubWrite(tid=100, reqid=client.4553.0:656, at_version=82'22, trim_to=0'0, roll_forward_to=78'19))", 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 35.738839548000001, 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.010050554, 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.468 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662006+0000", 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662007+0000", 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.5999999999999991e-07 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.469 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662470+0000", 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00046351299999999998 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662481+0000", 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0638999999999999e-05 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662489+0000", 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.0460000000000006e-06 2024-09-17T16:43:31.470 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662551+0000", 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2383000000000002e-05 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.662563+0000", 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1483e-05 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.471 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.672026+0000", 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0094634090000000008 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:42:55.672056+0000", 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.0120999999999998e-05 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.472 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.3s3 96/77 ECSubWrite(tid=70, reqid=osd.15.0:70, at_version=96'44, trim_to=0'0, roll_forward_to=95'42))", 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.935908757, 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080907759999999992, 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.473 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464937+0000", 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.9299999999999999e-07 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.474 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464963+0000", 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.6245999999999999e-05 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464976+0000", 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2801e-05 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.464997+0000", 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 2.0381999999999999e-05 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.475 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465087+0000", 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.0882000000000002e-05 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465099+0000", 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.2065000000000001e-05 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472973+0000", 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0078740049999999999 2024-09-17T16:43:31.476 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.473027+0000", 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 5.4002000000000002e-05 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=370, reqid=client.4553.0:793, at_version=96'64, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.935676778000001, 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.019745841, 2024-09-17T16:43:31.477 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.478 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.465169+0000", 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.6499999999999998e-07 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466510+0000", 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.001340489 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466529+0000", 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9086999999999999e-05 2024-09-17T16:43:31.479 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466540+0000", 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0669000000000001e-05 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466609+0000", 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.9511000000000006e-05 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.480 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.466619+0000", 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0059e-05 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484852+0000", 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.018232578999999999 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484915+0000", 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.2681999999999994e-05 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.481 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=372, reqid=client.4553.0:794, at_version=96'65, trim_to=0'0, roll_forward_to=95'61))", 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.930159371999999, 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014254615, 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:31.482 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470686+0000", 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.470687+0000", 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1200000000000001e-06 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.483 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472739+0000", 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0020515249999999998 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472755+0000", 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.6776999999999999e-05 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472766+0000", 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0015e-05 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.484 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.485 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.485 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472932+0000", 2024-09-17T16:43:31.489 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00016676500000000001 2024-09-17T16:43:31.489 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.489 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.489 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.489 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.472944+0000", 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.1749999999999999e-05 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484921+0000", 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.011976686 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.484941+0000", 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.9976999999999999e-05 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.490 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.1s2 96/77 ECSubWrite(tid=376, reqid=client.4553.0:795, at_version=96'66, trim_to=0'0, roll_forward_to=96'63))", 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.922787761999999, 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0077763559999999999, 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.491 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478058+0000", 2024-09-17T16:43:31.492 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.7000000000000004e-07 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478380+0000", 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00032185200000000002 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478395+0000", 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4484000000000001e-05 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.493 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478413+0000", 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.7961999999999998e-05 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478717+0000", 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00030417999999999998 2024-09-17T16:43:31.494 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.478728+0000", 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0662000000000001e-05 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.485798+0000", 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0070707010000000004 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.495 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.485834+0000", 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.5744999999999997e-05 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=82, reqid=client.4553.0:799, at_version=96'42, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.920240643, 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.014298085, 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.496 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480605+0000", 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.497 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.480606+0000", 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.096e-06 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481691+0000", 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0010850689999999999 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481709+0000", 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.8060999999999999e-05 2024-09-17T16:43:31.498 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481718+0000", 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.3000000000000007e-06 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481783+0000", 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 6.4850000000000004e-05 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.499 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.481793+0000", 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.7149999999999993e-06 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494862+0000", 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.013069404 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.494903+0000", 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.0590000000000003e-05 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.500 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=83, reqid=client.4553.0:800, at_version=96'43, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.913425334999999, 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0080848599999999993, 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.501 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487420+0000", 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.487421+0000", 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.0979999999999999e-06 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.502 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488035+0000", 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000613376 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488071+0000", 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 3.6551999999999998e-05 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.503 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.504 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.505 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488079+0000", 2024-09-17T16:43:31.505 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.3070000000000003e-06 2024-09-17T16:43:31.505 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.505 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488154+0000", 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.4250000000000002e-05 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.488162+0000", 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.8960000000000003e-06 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495348+0000", 2024-09-17T16:43:31.506 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0071863839999999997 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495505+0000", 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.000156997 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "description": "MOSDECSubOpWrite(3.4s3 96/34 ECSubWrite(tid=84, reqid=client.4553.0:801, at_version=96'44, trim_to=0'0, roll_forward_to=62'40))", 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "initiated_at": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "age": 21.905445789000002, 2024-09-17T16:43:31.507 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.009364509, 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "continuous": false, 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "type_data": { 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "flag_point": "reached pg", 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "events": [ 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "initiated", 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "header_read", 2024-09-17T16:43:31.508 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "throttled", 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495400+0000", 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 7.0500000000000003e-07 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "all_read", 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495948+0000", 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.00054791099999999999 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.509 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "dispatched", 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495963+0000", 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 1.4569999999999999e-05 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "queued_for_pg", 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.495971+0000", 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.6200000000000005e-06 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "reached_pg", 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496056+0000", 2024-09-17T16:43:31.510 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 8.4425000000000006e-05 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_started", 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.496065+0000", 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 9.2420000000000006e-06 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "sub_op_committed", 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504716+0000", 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 0.0086504779999999996 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: { 2024-09-17T16:43:31.511 INFO:teuthology.orchestra.run.smithi183.stdout: "event": "done", 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: "time": "2024-09-17T16:43:09.504764+0000", 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: "duration": 4.8557999999999998e-05 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-17T16:43:31.512 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:31.514 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T16:43:31.514 INFO:tasks.ceph.osd.11.smithi183.stderr:2024-09-17T16:43:31.511+0000 7f14419ce640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 33518) UID: 0 2024-09-17T16:43:31.602 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'unique_pool_0' removed 2024-09-17T16:43:31.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T16:43:31.614 INFO:tasks.ceph.osd.4.smithi060.stderr:2024-09-17T16:43:31.611+0000 7f07490c4640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33882) UID: 0 2024-09-17T16:43:31.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T16:43:31.619 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-17T16:43:31.628 INFO:tasks.thrashosds:joining thrashosds 2024-09-17T16:43:31.660 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:31.660 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:31.660 INFO:teuthology.orchestra.run.smithi183.stdout: "num_ops": 0 2024-09-17T16:43:31.660 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:31.670 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T16:43:31.747 INFO:teuthology.orchestra.run.smithi060.stdout:osd.0: {} 2024-09-17T16:43:31.747 INFO:teuthology.orchestra.run.smithi060.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T16:43:31.765 INFO:teuthology.orchestra.run.smithi060.stdout:osd.1: {} 2024-09-17T16:43:31.765 INFO:teuthology.orchestra.run.smithi060.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-17T16:43:31.772 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-17T16:43:31.773 INFO:teuthology.orchestra.run.smithi183.stdout: "ops": [], 2024-09-17T16:43:31.773 INFO:teuthology.orchestra.run.smithi183.stdout: "complaint_time": 30, 2024-09-17T16:43:31.773 INFO:teuthology.orchestra.run.smithi183.stdout: "num_blocked_ops": 0 2024-09-17T16:43:31.773 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-17T16:43:31.781 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T16:43:31.784 INFO:teuthology.orchestra.run.smithi060.stdout:osd.2: {} 2024-09-17T16:43:31.784 INFO:teuthology.orchestra.run.smithi060.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T16:43:31.800 INFO:teuthology.orchestra.run.smithi060.stdout:osd.3: {} 2024-09-17T16:43:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T16:43:31.818 INFO:teuthology.orchestra.run.smithi060.stdout:osd.4: {} 2024-09-17T16:43:31.818 INFO:teuthology.orchestra.run.smithi060.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T16:43:31.835 INFO:teuthology.orchestra.run.smithi060.stdout:osd.5: {} 2024-09-17T16:43:31.836 INFO:teuthology.orchestra.run.smithi060.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T16:43:31.852 INFO:teuthology.orchestra.run.smithi060.stdout:osd.6: {} 2024-09-17T16:43:31.853 INFO:teuthology.orchestra.run.smithi060.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T16:43:31.869 INFO:teuthology.orchestra.run.smithi060.stdout:osd.7: {} 2024-09-17T16:43:31.869 INFO:teuthology.orchestra.run.smithi060.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T16:43:31.884 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:31.884 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:31.885 INFO:teuthology.orchestra.run.smithi060.stdout:osd.8: {} 2024-09-17T16:43:31.885 INFO:teuthology.orchestra.run.smithi060.stderr:osd.8: osd_enable_op_tracker = '' 2024-09-17T16:43:31.893 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-09-17T16:43:31.902 INFO:teuthology.orchestra.run.smithi060.stdout:osd.9: {} 2024-09-17T16:43:31.902 INFO:teuthology.orchestra.run.smithi060.stderr:osd.9: osd_enable_op_tracker = '' 2024-09-17T16:43:31.919 INFO:teuthology.orchestra.run.smithi060.stdout:osd.10: {} 2024-09-17T16:43:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:osd.10: osd_enable_op_tracker = '' 2024-09-17T16:43:31.935 INFO:teuthology.orchestra.run.smithi060.stdout:osd.11: {} 2024-09-17T16:43:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:osd.11: osd_enable_op_tracker = '' 2024-09-17T16:43:31.953 INFO:teuthology.orchestra.run.smithi060.stdout:osd.12: {} 2024-09-17T16:43:31.953 INFO:teuthology.orchestra.run.smithi060.stderr:osd.12: osd_enable_op_tracker = '' 2024-09-17T16:43:31.970 INFO:teuthology.orchestra.run.smithi060.stdout:osd.13: {} 2024-09-17T16:43:31.970 INFO:teuthology.orchestra.run.smithi060.stderr:osd.13: osd_enable_op_tracker = '' 2024-09-17T16:43:31.987 INFO:teuthology.orchestra.run.smithi060.stdout:osd.14: {} 2024-09-17T16:43:31.987 INFO:teuthology.orchestra.run.smithi060.stderr:osd.14: osd_enable_op_tracker = '' 2024-09-17T16:43:31.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:43:31.985+0000 7f2a1596d640 0 -- 172.21.15.60:0/2159580220 >> [v2:172.21.15.183:6810/2101706733,v1:172.21.15.183:6811/2101706733] conn(0x7f2a10223fb0 msgr2=0x7f2a102263a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T16:43:31.999 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:31.999 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:32.007 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-09-17T16:43:32.115 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:32.115 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:32.125 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-09-17T16:43:32.207 INFO:teuthology.orchestra.run.smithi060.stdout:osd.15: {} 2024-09-17T16:43:32.207 INFO:teuthology.orchestra.run.smithi060.stderr:osd.15: osd_enable_op_tracker = '' 2024-09-17T16:43:32.229 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:32.229 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:32.238 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-09-17T16:43:32.341 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:32.341 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:32.350 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-09-17T16:43:32.454 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:32.454 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:32.462 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-09-17T16:43:32.565 INFO:teuthology.orchestra.run.smithi183.stdout:ERROR: (22) Invalid argument 2024-09-17T16:43:32.565 INFO:teuthology.orchestra.run.smithi183.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T16:43:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is set 2024-09-17T16:43:34.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-17T16:43:34.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T16:43:34.751 INFO:teuthology.orchestra.run.smithi060.stdout:mon.a: {} 2024-09-17T16:43:34.751 INFO:teuthology.orchestra.run.smithi060.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T16:43:34.761 INFO:teuthology.orchestra.run.smithi060.stdout:mon.b: {} 2024-09-17T16:43:34.761 INFO:teuthology.orchestra.run.smithi060.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T16:43:34.771 INFO:teuthology.orchestra.run.smithi060.stdout:mon.c: {} 2024-09-17T16:43:34.771 INFO:teuthology.orchestra.run.smithi060.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T16:43:34.783 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T16:43:35.620 INFO:teuthology.orchestra.run.smithi060.stderr:noscrub is unset 2024-09-17T16:43:35.621 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T16:43:35.637 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T16:43:35.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T16:43:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T16:43:36.628 INFO:teuthology.orchestra.run.smithi060.stderr:nodeep-scrub is unset 2024-09-17T16:43:36.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T16:43:37.631 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T16:43:37.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-17T16:43:38.632 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-17T16:43:38.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-09-17T16:43:39.641 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.8 to 1 (10000) 2024-09-17T16:43:39.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-09-17T16:43:40.643 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-09-17T16:43:40.661 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-09-17T16:43:41.652 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.12 to 1 (10000) 2024-09-17T16:43:41.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 12 1 2024-09-17T16:43:42.653 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.12 primary-affinity to 1 (8655362) 2024-09-17T16:43:42.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T16:43:43.658 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T16:43:43.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-17T16:43:44.664 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-17T16:43:44.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T16:43:45.677 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T16:43:45.695 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-17T16:43:46.679 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-17T16:43:47.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-09-17T16:43:47.688 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.9 to 1 (10000) 2024-09-17T16:43:47.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 1 2024-09-17T16:43:48.690 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-09-17T16:43:48.707 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-09-17T16:43:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.13 to 1 (10000) 2024-09-17T16:43:49.712 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 1 2024-09-17T16:43:50.703 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.13 primary-affinity to 1 (8655362) 2024-09-17T16:43:50.721 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T16:43:51.715 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T16:43:51.732 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T16:43:52.717 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T16:43:52.735 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T16:43:53.723 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T16:43:53.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-17T16:43:54.731 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-17T16:43:54.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-09-17T16:43:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.10 to 1 (10000) 2024-09-17T16:43:55.758 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 10 1 2024-09-17T16:43:56.748 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-09-17T16:43:56.766 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-09-17T16:43:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.14 to 1 (10000) 2024-09-17T16:43:57.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 1 2024-09-17T16:43:58.759 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.14 primary-affinity to 1 (8655362) 2024-09-17T16:43:58.775 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T16:43:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T16:43:59.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-17T16:44:00.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:44:00.096+0000 7fbbc1b61640 0 --2- 172.21.15.60:0/973739004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbbc15df50 0x7fbbbc15b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T16:44:00.773 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-17T16:44:00.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T16:44:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T16:44:01.800 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-17T16:44:02.789 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-17T16:44:02.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-09-17T16:44:03.795 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.11 to 1 (10000) 2024-09-17T16:44:03.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 1 2024-09-17T16:44:04.803 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-09-17T16:44:04.821 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-09-17T16:44:05.814 INFO:teuthology.orchestra.run.smithi060.stderr:reweighted osd.15 to 1 (10000) 2024-09-17T16:44:05.831 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-09-17T16:44:06.816 INFO:teuthology.orchestra.run.smithi060.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-09-17T16:44:06.833 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-17T16:44:06.833 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-17T16:44:06.834 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-17T16:44:06.834 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-17T16:44:06.834 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T16:44:06.834 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:07.144 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":151,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:44:06.813269+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:43:17.447861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T16:41:53.164635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9700000286102295,"score_stable":3.9700000286102295,"optimal_score":0.62999999523162842,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:09.428020+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:56.443024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.553201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.139316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:59.621144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:59.403015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.797759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:10.319477+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:51.340953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.967734+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.457055+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:01.609868+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:54.548588+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:42.062460+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:46.531494+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.031579+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[11,4]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":38,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:44:07.157 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T16:44:07.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:44:07.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:07.459 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":151,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:44:06.813269+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:43:17.447861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T16:41:53.164635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9700000286102295,"score_stable":3.9700000286102295,"optimal_score":0.62999999523162842,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:09.428020+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:56.443024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.553201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.139316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:59.621144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:59.403015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.797759+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:10.319477+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:51.340953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.967734+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.457055+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:01.609868+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:54.548588+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:42.062460+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:46.531494+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.031579+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[11,4]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":38,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:44:07.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T16:44:07.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T16:44:07.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T16:44:07.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T16:44:07.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T16:44:07.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T16:44:07.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T16:44:07.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T16:44:07.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-09-17T16:44:07.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-09-17T16:44:07.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-09-17T16:44:07.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-09-17T16:44:07.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-09-17T16:44:07.477 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-09-17T16:44:07.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-09-17T16:44:07.478 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-09-17T16:44:07.879 INFO:teuthology.orchestra.run.smithi060.stdout:103079215137 2024-09-17T16:44:07.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-17T16:44:07.921 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:07.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-17T16:44:07.942 INFO:teuthology.orchestra.run.smithi060.stdout:90194313249 2024-09-17T16:44:07.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-17T16:44:07.961 INFO:teuthology.orchestra.run.smithi060.stdout:103079215135 2024-09-17T16:44:07.961 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:07.962 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T16:44:07.962 INFO:teuthology.orchestra.run.smithi060.stdout:103079215137 2024-09-17T16:44:07.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T16:44:07.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-17T16:44:07.964 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:07.964 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T16:44:07.970 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:07.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T16:44:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:94489280543 2024-09-17T16:44:07.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-17T16:44:07.979 INFO:teuthology.orchestra.run.smithi060.stdout:98784247841 2024-09-17T16:44:07.980 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T16:44:07.982 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:07.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-17T16:44:07.988 INFO:teuthology.orchestra.run.smithi060.stdout:90194313249 2024-09-17T16:44:07.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-17T16:44:08.003 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:08.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-17T16:44:08.045 INFO:teuthology.orchestra.run.smithi060.stdout:103079215138 2024-09-17T16:44:08.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-17T16:44:08.042+0000 7f3a13fff640 0 --2- 172.21.15.60:0/1563516018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a141eef90 0x7f3a141f02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T16:44:08.046 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T16:44:08.062 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:08.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T16:44:08.198 INFO:teuthology.orchestra.run.smithi060.stdout:107374182432 2024-09-17T16:44:08.199 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T16:44:08.954 INFO:teuthology.orchestra.run.smithi060.stdout:107374182433 2024-09-17T16:44:08.990 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182433 for osd.3 2024-09-17T16:44:08.991 INFO:teuthology.orchestra.run.smithi060.stdout:103079215136 2024-09-17T16:44:09.013 INFO:teuthology.orchestra.run.smithi060.stdout:90194313247 2024-09-17T16:44:09.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313249 got 90194313247 for osd.8 2024-09-17T16:44:09.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215137 got 103079215136 for osd.10 2024-09-17T16:44:09.074 INFO:teuthology.orchestra.run.smithi060.stdout:94489280542 2024-09-17T16:44:09.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280544 got 94489280542 for osd.2 2024-09-17T16:44:09.154 INFO:teuthology.orchestra.run.smithi060.stdout:107374182433 2024-09-17T16:44:09.183 INFO:teuthology.orchestra.run.smithi060.stdout:90194313247 2024-09-17T16:44:09.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182433 for osd.15 2024-09-17T16:44:09.211 INFO:teuthology.orchestra.run.smithi060.stdout:94489280542 2024-09-17T16:44:09.211 INFO:teuthology.orchestra.run.smithi060.stdout:103079215136 2024-09-17T16:44:09.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313249 got 90194313247 for osd.9 2024-09-17T16:44:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:107374182433 2024-09-17T16:44:09.254 INFO:teuthology.orchestra.run.smithi060.stdout:103079215134 2024-09-17T16:44:09.257 INFO:teuthology.orchestra.run.smithi060.stdout:94489280542 2024-09-17T16:44:09.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215137 got 103079215136 for osd.12 2024-09-17T16:44:09.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280543 got 94489280542 for osd.13 2024-09-17T16:44:09.272 INFO:teuthology.orchestra.run.smithi060.stdout:107374182433 2024-09-17T16:44:09.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182433 for osd.14 2024-09-17T16:44:09.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280544 got 94489280542 for osd.4 2024-09-17T16:44:09.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215135 got 103079215134 for osd.1 2024-09-17T16:44:09.279 INFO:teuthology.orchestra.run.smithi060.stdout:107374182431 2024-09-17T16:44:09.283 INFO:teuthology.orchestra.run.smithi060.stdout:98784247840 2024-09-17T16:44:09.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182433 for osd.11 2024-09-17T16:44:09.290 INFO:teuthology.orchestra.run.smithi060.stdout:103079215137 2024-09-17T16:44:09.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182432 got 107374182431 for osd.7 2024-09-17T16:44:09.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247841 got 98784247840 for osd.5 2024-09-17T16:44:09.306 INFO:teuthology.orchestra.run.smithi060.stdout:94489280542 2024-09-17T16:44:09.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215138 got 103079215137 for osd.6 2024-09-17T16:44:09.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280544 got 94489280542 for osd.0 2024-09-17T16:44:09.992 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T16:44:10.034 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-09-17T16:44:10.037 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-09-17T16:44:10.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T16:44:10.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-09-17T16:44:10.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-09-17T16:44:10.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-09-17T16:44:10.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-09-17T16:44:10.277 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-09-17T16:44:10.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T16:44:10.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T16:44:10.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-09-17T16:44:10.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T16:44:10.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T16:44:10.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T16:44:10.321 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T16:44:10.480 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:10.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182434 for osd.3 2024-09-17T16:44:10.518 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:90194313249 2024-09-17T16:44:10.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313249 got 90194313249 for osd.8 2024-09-17T16:44:10.597 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:10.766 INFO:teuthology.orchestra.run.smithi060.stdout:103079215137 2024-09-17T16:44:10.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215137 got 103079215137 for osd.10 2024-09-17T16:44:10.835 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:10.844 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:10.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280544 got 94489280544 for osd.2 2024-09-17T16:44:10.900 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:10.989 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:11.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182434 for osd.15 2024-09-17T16:44:11.021 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.044 INFO:teuthology.orchestra.run.smithi060.stdout:90194313249 2024-09-17T16:44:11.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313249 got 90194313249 for osd.9 2024-09-17T16:44:11.065 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.093 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:11.135 INFO:teuthology.orchestra.run.smithi060.stdout:103079215137 2024-09-17T16:44:11.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280543 got 94489280544 for osd.13 2024-09-17T16:44:11.140 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.150 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:11.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215137 got 103079215137 for osd.12 2024-09-17T16:44:11.166 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182434 for osd.14 2024-09-17T16:44:11.176 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.272 INFO:teuthology.orchestra.run.smithi060.stdout:107374182432 2024-09-17T16:44:11.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182432 got 107374182432 for osd.7 2024-09-17T16:44:11.286 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.325 INFO:teuthology.orchestra.run.smithi060.stdout:107374182434 2024-09-17T16:44:11.325 INFO:teuthology.orchestra.run.smithi060.stdout:103079215135 2024-09-17T16:44:11.335 INFO:teuthology.orchestra.run.smithi060.stdout:103079215138 2024-09-17T16:44:11.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215135 got 103079215135 for osd.1 2024-09-17T16:44:11.341 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182434 got 107374182434 for osd.11 2024-09-17T16:44:11.341 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215138 got 103079215138 for osd.6 2024-09-17T16:44:11.354 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:11.354 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.362 INFO:teuthology.orchestra.run.smithi060.stdout:98784247841 2024-09-17T16:44:11.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280544 got 94489280544 for osd.0 2024-09-17T16:44:11.370 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.375 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247841 got 98784247841 for osd.5 2024-09-17T16:44:11.375 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.402 INFO:teuthology.orchestra.run.smithi060.stdout:94489280544 2024-09-17T16:44:11.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280544 got 94489280544 for osd.4 2024-09-17T16:44:11.416 DEBUG:teuthology.parallel:result is None 2024-09-17T16:44:11.416 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T16:44:11.417 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:11.754 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:11.766 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-17T16:44:11.072766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":617228,"kb_used_data":27932,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509332212,"statfs":{"total":1546188226560,"available":1545556185088,"internally_reserved":0,"allocated":28602368,"data_stored":22746490,"data_compressed":4149265,"data_compressed_allocated":8364032,"data_compressed_original":17633280,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258737"},"pg_stats":[{"pgid":"1.0","version":"24'92","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.929732+0000","last_change":"2024-09-17T16:44:07.929732+0000","last_active":"2024-09-17T16:44:07.929732+0000","last_peered":"2024-09-17T16:44:07.929732+0000","last_clean":"2024-09-17T16:44:07.929732+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:07.929732+0000","last_undegraded":"2024-09-17T16:44:07.929732+0000","last_fullsized":"2024-09-17T16:44:07.929732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-17T16:44:07.929630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.929630+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:33.953343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054183+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:44:07.054183+0000","last_peered":"2024-09-17T16:44:07.054183+0000","last_clean":"2024-09-17T16:44:07.054183+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:07.054183+0000","last_undegraded":"2024-09-17T16:44:07.054183+0000","last_fullsized":"2024-09-17T16:44:07.054183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.501423+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:44:07.501423+0000","last_peered":"2024-09-17T16:44:07.501423+0000","last_clean":"2024-09-17T16:44:07.501423+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:07.501423+0000","last_undegraded":"2024-09-17T16:44:07.501423+0000","last_fullsized":"2024-09-17T16:44:07.501423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.738472+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:44:06.738472+0000","last_peered":"2024-09-17T16:44:06.738472+0000","last_clean":"2024-09-17T16:44:06.738472+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:06.738472+0000","last_undegraded":"2024-09-17T16:44:06.738472+0000","last_fullsized":"2024-09-17T16:44:06.738472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":62,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816966+0000","last_change":"2024-09-17T16:43:51.720905+0000","last_active":"2024-09-17T16:44:06.816966+0000","last_peered":"2024-09-17T16:44:06.816966+0000","last_clean":"2024-09-17T16:44:06.816966+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:06.816966+0000","last_undegraded":"2024-09-17T16:44:06.816966+0000","last_fullsized":"2024-09-17T16:44:06.816966+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:33.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054199+0000","last_change":"2024-09-17T16:43:28.943379+0000","last_active":"2024-09-17T16:44:07.054199+0000","last_peered":"2024-09-17T16:44:07.054199+0000","last_clean":"2024-09-17T16:44:07.054199+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:07.054199+0000","last_undegraded":"2024-09-17T16:44:07.054199+0000","last_fullsized":"2024-09-17T16:44:07.054199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:28.943300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:28.943300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:57.479658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":269,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T16:44:10.446195+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:44:10.446195+0000","last_peered":"2024-09-17T16:44:10.446195+0000","last_clean":"2024-09-17T16:44:10.446195+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:10.446195+0000","last_undegraded":"2024-09-17T16:44:10.446195+0000","last_fullsized":"2024-09-17T16:44:10.446195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.410022+0000","last_change":"2024-09-17T16:44:07.409977+0000","last_active":"2024-09-17T16:44:07.410022+0000","last_peered":"2024-09-17T16:44:07.410022+0000","last_clean":"2024-09-17T16:44:07.410022+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:07.410022+0000","last_undegraded":"2024-09-17T16:44:07.410022+0000","last_fullsized":"2024-09-17T16:44:07.410022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:07.409917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.409917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:36.281067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816965+0000","last_change":"2024-09-17T16:43:51.873562+0000","last_active":"2024-09-17T16:44:06.816965+0000","last_peered":"2024-09-17T16:44:06.816965+0000","last_clean":"2024-09-17T16:44:06.816965+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:06.816965+0000","last_undegraded":"2024-09-17T16:44:06.816965+0000","last_fullsized":"2024-09-17T16:44:06.816965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:24.703829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182434,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1826816,"data_stored":1888063,"data_compressed":266517,"data_compressed_allocated":552960,"data_compressed_original":1564672,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1789952,"data_stored":1359154,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1826816,"data_stored":1878448,"data_compressed":263632,"data_compressed_allocated":548864,"data_compressed_original":1544192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215136,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215138,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55160,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316680,"statfs":{"total":96636764160,"available":96580280320,"internally_reserved":0,"allocated":1802240,"data_stored":1368811,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1748992,"data_stored":1330290,"data_compressed":253050,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182432,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:11.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:12.065 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:12.066 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:12.078 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-17T16:44:11.072766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":617228,"kb_used_data":27932,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509332212,"statfs":{"total":1546188226560,"available":1545556185088,"internally_reserved":0,"allocated":28602368,"data_stored":22746490,"data_compressed":4149265,"data_compressed_allocated":8364032,"data_compressed_original":17633280,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258737"},"pg_stats":[{"pgid":"1.0","version":"24'92","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.929732+0000","last_change":"2024-09-17T16:44:07.929732+0000","last_active":"2024-09-17T16:44:07.929732+0000","last_peered":"2024-09-17T16:44:07.929732+0000","last_clean":"2024-09-17T16:44:07.929732+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:07.929732+0000","last_undegraded":"2024-09-17T16:44:07.929732+0000","last_fullsized":"2024-09-17T16:44:07.929732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-17T16:44:07.929630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.929630+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:33.953343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054183+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:44:07.054183+0000","last_peered":"2024-09-17T16:44:07.054183+0000","last_clean":"2024-09-17T16:44:07.054183+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:07.054183+0000","last_undegraded":"2024-09-17T16:44:07.054183+0000","last_fullsized":"2024-09-17T16:44:07.054183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.501423+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:44:07.501423+0000","last_peered":"2024-09-17T16:44:07.501423+0000","last_clean":"2024-09-17T16:44:07.501423+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:07.501423+0000","last_undegraded":"2024-09-17T16:44:07.501423+0000","last_fullsized":"2024-09-17T16:44:07.501423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.738472+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:44:06.738472+0000","last_peered":"2024-09-17T16:44:06.738472+0000","last_clean":"2024-09-17T16:44:06.738472+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:06.738472+0000","last_undegraded":"2024-09-17T16:44:06.738472+0000","last_fullsized":"2024-09-17T16:44:06.738472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":62,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816966+0000","last_change":"2024-09-17T16:43:51.720905+0000","last_active":"2024-09-17T16:44:06.816966+0000","last_peered":"2024-09-17T16:44:06.816966+0000","last_clean":"2024-09-17T16:44:06.816966+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:06.816966+0000","last_undegraded":"2024-09-17T16:44:06.816966+0000","last_fullsized":"2024-09-17T16:44:06.816966+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:33.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054199+0000","last_change":"2024-09-17T16:43:28.943379+0000","last_active":"2024-09-17T16:44:07.054199+0000","last_peered":"2024-09-17T16:44:07.054199+0000","last_clean":"2024-09-17T16:44:07.054199+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:07.054199+0000","last_undegraded":"2024-09-17T16:44:07.054199+0000","last_fullsized":"2024-09-17T16:44:07.054199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:28.943300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:28.943300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:57.479658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":269,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T16:44:10.446195+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:44:10.446195+0000","last_peered":"2024-09-17T16:44:10.446195+0000","last_clean":"2024-09-17T16:44:10.446195+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:10.446195+0000","last_undegraded":"2024-09-17T16:44:10.446195+0000","last_fullsized":"2024-09-17T16:44:10.446195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.410022+0000","last_change":"2024-09-17T16:44:07.409977+0000","last_active":"2024-09-17T16:44:07.410022+0000","last_peered":"2024-09-17T16:44:07.410022+0000","last_clean":"2024-09-17T16:44:07.410022+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:07.410022+0000","last_undegraded":"2024-09-17T16:44:07.410022+0000","last_fullsized":"2024-09-17T16:44:07.410022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:07.409917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.409917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:36.281067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816965+0000","last_change":"2024-09-17T16:43:51.873562+0000","last_active":"2024-09-17T16:44:06.816965+0000","last_peered":"2024-09-17T16:44:06.816965+0000","last_clean":"2024-09-17T16:44:06.816965+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:06.816965+0000","last_undegraded":"2024-09-17T16:44:06.816965+0000","last_fullsized":"2024-09-17T16:44:06.816965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:24.703829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182434,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1826816,"data_stored":1888063,"data_compressed":266517,"data_compressed_allocated":552960,"data_compressed_original":1564672,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1789952,"data_stored":1359154,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1826816,"data_stored":1878448,"data_compressed":263632,"data_compressed_allocated":548864,"data_compressed_original":1544192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215136,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215138,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55160,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316680,"statfs":{"total":96636764160,"available":96580280320,"internally_reserved":0,"allocated":1802240,"data_stored":1368811,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1748992,"data_stored":1330290,"data_compressed":253050,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182432,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:12.079 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T16:44:12.079 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T16:44:12.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T16:44:12.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:12.383 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:12.383 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:12.395 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-17T16:44:11.072766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":617228,"kb_used_data":27932,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509332212,"statfs":{"total":1546188226560,"available":1545556185088,"internally_reserved":0,"allocated":28602368,"data_stored":22746490,"data_compressed":4149265,"data_compressed_allocated":8364032,"data_compressed_original":17633280,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258737"},"pg_stats":[{"pgid":"1.0","version":"24'92","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.929732+0000","last_change":"2024-09-17T16:44:07.929732+0000","last_active":"2024-09-17T16:44:07.929732+0000","last_peered":"2024-09-17T16:44:07.929732+0000","last_clean":"2024-09-17T16:44:07.929732+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:07.929732+0000","last_undegraded":"2024-09-17T16:44:07.929732+0000","last_fullsized":"2024-09-17T16:44:07.929732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-17T16:44:07.929630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.929630+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:33.953343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054183+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:44:07.054183+0000","last_peered":"2024-09-17T16:44:07.054183+0000","last_clean":"2024-09-17T16:44:07.054183+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:07.054183+0000","last_undegraded":"2024-09-17T16:44:07.054183+0000","last_fullsized":"2024-09-17T16:44:07.054183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.501423+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:44:07.501423+0000","last_peered":"2024-09-17T16:44:07.501423+0000","last_clean":"2024-09-17T16:44:07.501423+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:07.501423+0000","last_undegraded":"2024-09-17T16:44:07.501423+0000","last_fullsized":"2024-09-17T16:44:07.501423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.738472+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:44:06.738472+0000","last_peered":"2024-09-17T16:44:06.738472+0000","last_clean":"2024-09-17T16:44:06.738472+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:06.738472+0000","last_undegraded":"2024-09-17T16:44:06.738472+0000","last_fullsized":"2024-09-17T16:44:06.738472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":62,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816966+0000","last_change":"2024-09-17T16:43:51.720905+0000","last_active":"2024-09-17T16:44:06.816966+0000","last_peered":"2024-09-17T16:44:06.816966+0000","last_clean":"2024-09-17T16:44:06.816966+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:06.816966+0000","last_undegraded":"2024-09-17T16:44:06.816966+0000","last_fullsized":"2024-09-17T16:44:06.816966+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:33.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054199+0000","last_change":"2024-09-17T16:43:28.943379+0000","last_active":"2024-09-17T16:44:07.054199+0000","last_peered":"2024-09-17T16:44:07.054199+0000","last_clean":"2024-09-17T16:44:07.054199+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:07.054199+0000","last_undegraded":"2024-09-17T16:44:07.054199+0000","last_fullsized":"2024-09-17T16:44:07.054199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:28.943300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:28.943300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:57.479658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":269,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T16:44:10.446195+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:44:10.446195+0000","last_peered":"2024-09-17T16:44:10.446195+0000","last_clean":"2024-09-17T16:44:10.446195+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:10.446195+0000","last_undegraded":"2024-09-17T16:44:10.446195+0000","last_fullsized":"2024-09-17T16:44:10.446195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.410022+0000","last_change":"2024-09-17T16:44:07.409977+0000","last_active":"2024-09-17T16:44:07.410022+0000","last_peered":"2024-09-17T16:44:07.410022+0000","last_clean":"2024-09-17T16:44:07.410022+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:07.410022+0000","last_undegraded":"2024-09-17T16:44:07.410022+0000","last_fullsized":"2024-09-17T16:44:07.410022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:07.409917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.409917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:36.281067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816965+0000","last_change":"2024-09-17T16:43:51.873562+0000","last_active":"2024-09-17T16:44:06.816965+0000","last_peered":"2024-09-17T16:44:06.816965+0000","last_clean":"2024-09-17T16:44:06.816965+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:06.816965+0000","last_undegraded":"2024-09-17T16:44:06.816965+0000","last_fullsized":"2024-09-17T16:44:06.816965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:24.703829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182434,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1826816,"data_stored":1888063,"data_compressed":266517,"data_compressed_allocated":552960,"data_compressed_original":1564672,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1789952,"data_stored":1359154,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1826816,"data_stored":1878448,"data_compressed":263632,"data_compressed_allocated":548864,"data_compressed_original":1544192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215136,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215138,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55160,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316680,"statfs":{"total":96636764160,"available":96580280320,"internally_reserved":0,"allocated":1802240,"data_stored":1368811,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1748992,"data_stored":1330290,"data_compressed":253050,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182432,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:12.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:12.695 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:12.708 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-17T16:44:11.072766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":617228,"kb_used_data":27932,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509332212,"statfs":{"total":1546188226560,"available":1545556185088,"internally_reserved":0,"allocated":28602368,"data_stored":22746490,"data_compressed":4149265,"data_compressed_allocated":8364032,"data_compressed_original":17633280,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258737"},"pg_stats":[{"pgid":"1.0","version":"24'92","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.929732+0000","last_change":"2024-09-17T16:44:07.929732+0000","last_active":"2024-09-17T16:44:07.929732+0000","last_peered":"2024-09-17T16:44:07.929732+0000","last_clean":"2024-09-17T16:44:07.929732+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:07.929732+0000","last_undegraded":"2024-09-17T16:44:07.929732+0000","last_fullsized":"2024-09-17T16:44:07.929732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-17T16:44:07.929630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.929630+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:33.953343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054183+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:44:07.054183+0000","last_peered":"2024-09-17T16:44:07.054183+0000","last_clean":"2024-09-17T16:44:07.054183+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:07.054183+0000","last_undegraded":"2024-09-17T16:44:07.054183+0000","last_fullsized":"2024-09-17T16:44:07.054183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.501423+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:44:07.501423+0000","last_peered":"2024-09-17T16:44:07.501423+0000","last_clean":"2024-09-17T16:44:07.501423+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:07.501423+0000","last_undegraded":"2024-09-17T16:44:07.501423+0000","last_fullsized":"2024-09-17T16:44:07.501423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.738472+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:44:06.738472+0000","last_peered":"2024-09-17T16:44:06.738472+0000","last_clean":"2024-09-17T16:44:06.738472+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:06.738472+0000","last_undegraded":"2024-09-17T16:44:06.738472+0000","last_fullsized":"2024-09-17T16:44:06.738472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":62,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816966+0000","last_change":"2024-09-17T16:43:51.720905+0000","last_active":"2024-09-17T16:44:06.816966+0000","last_peered":"2024-09-17T16:44:06.816966+0000","last_clean":"2024-09-17T16:44:06.816966+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:06.816966+0000","last_undegraded":"2024-09-17T16:44:06.816966+0000","last_fullsized":"2024-09-17T16:44:06.816966+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:33.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054199+0000","last_change":"2024-09-17T16:43:28.943379+0000","last_active":"2024-09-17T16:44:07.054199+0000","last_peered":"2024-09-17T16:44:07.054199+0000","last_clean":"2024-09-17T16:44:07.054199+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:07.054199+0000","last_undegraded":"2024-09-17T16:44:07.054199+0000","last_fullsized":"2024-09-17T16:44:07.054199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:28.943300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:28.943300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:57.479658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":269,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T16:44:10.446195+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:44:10.446195+0000","last_peered":"2024-09-17T16:44:10.446195+0000","last_clean":"2024-09-17T16:44:10.446195+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:10.446195+0000","last_undegraded":"2024-09-17T16:44:10.446195+0000","last_fullsized":"2024-09-17T16:44:10.446195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.410022+0000","last_change":"2024-09-17T16:44:07.409977+0000","last_active":"2024-09-17T16:44:07.410022+0000","last_peered":"2024-09-17T16:44:07.410022+0000","last_clean":"2024-09-17T16:44:07.410022+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:07.410022+0000","last_undegraded":"2024-09-17T16:44:07.410022+0000","last_fullsized":"2024-09-17T16:44:07.410022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:07.409917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.409917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:36.281067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816965+0000","last_change":"2024-09-17T16:43:51.873562+0000","last_active":"2024-09-17T16:44:06.816965+0000","last_peered":"2024-09-17T16:44:06.816965+0000","last_clean":"2024-09-17T16:44:06.816965+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:06.816965+0000","last_undegraded":"2024-09-17T16:44:06.816965+0000","last_fullsized":"2024-09-17T16:44:06.816965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:24.703829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182434,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1826816,"data_stored":1888063,"data_compressed":266517,"data_compressed_allocated":552960,"data_compressed_original":1564672,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1789952,"data_stored":1359154,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1826816,"data_stored":1878448,"data_compressed":263632,"data_compressed_allocated":548864,"data_compressed_original":1544192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215136,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215138,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55160,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316680,"statfs":{"total":96636764160,"available":96580280320,"internally_reserved":0,"allocated":1802240,"data_stored":1368811,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1748992,"data_stored":1330290,"data_compressed":253050,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182432,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:12.709 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T16:44:12.710 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:13.010 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:13.011 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:13.023 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-17T16:44:11.072766+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":617228,"kb_used_data":27932,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509332212,"statfs":{"total":1546188226560,"available":1545556185088,"internally_reserved":0,"allocated":28602368,"data_stored":22746490,"data_compressed":4149265,"data_compressed_allocated":8364032,"data_compressed_original":17633280,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258737"},"pg_stats":[{"pgid":"1.0","version":"24'92","reported_seq":271,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.929732+0000","last_change":"2024-09-17T16:44:07.929732+0000","last_active":"2024-09-17T16:44:07.929732+0000","last_peered":"2024-09-17T16:44:07.929732+0000","last_clean":"2024-09-17T16:44:07.929732+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:07.929732+0000","last_undegraded":"2024-09-17T16:44:07.929732+0000","last_fullsized":"2024-09-17T16:44:07.929732+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-17T16:44:07.929630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.929630+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:33.953343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":267,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054183+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:44:07.054183+0000","last_peered":"2024-09-17T16:44:07.054183+0000","last_clean":"2024-09-17T16:44:07.054183+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:07.054183+0000","last_undegraded":"2024-09-17T16:44:07.054183+0000","last_fullsized":"2024-09-17T16:44:07.054183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":258,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.501423+0000","last_change":"2024-09-17T16:41:58.299399+0000","last_active":"2024-09-17T16:44:07.501423+0000","last_peered":"2024-09-17T16:44:07.501423+0000","last_clean":"2024-09-17T16:44:07.501423+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:07.501423+0000","last_undegraded":"2024-09-17T16:44:07.501423+0000","last_fullsized":"2024-09-17T16:44:07.501423+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.594065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.738472+0000","last_change":"2024-09-17T16:41:58.299625+0000","last_active":"2024-09-17T16:44:06.738472+0000","last_peered":"2024-09-17T16:44:06.738472+0000","last_clean":"2024-09-17T16:44:06.738472+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:06.738472+0000","last_undegraded":"2024-09-17T16:44:06.738472+0000","last_fullsized":"2024-09-17T16:44:06.738472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:41:54.100364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:09.359140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":62,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816966+0000","last_change":"2024-09-17T16:43:51.720905+0000","last_active":"2024-09-17T16:44:06.816966+0000","last_peered":"2024-09-17T16:44:06.816966+0000","last_clean":"2024-09-17T16:44:06.816966+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:06.816966+0000","last_undegraded":"2024-09-17T16:44:06.816966+0000","last_fullsized":"2024-09-17T16:44:06.816966+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:33.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.054199+0000","last_change":"2024-09-17T16:43:28.943379+0000","last_active":"2024-09-17T16:44:07.054199+0000","last_peered":"2024-09-17T16:44:07.054199+0000","last_clean":"2024-09-17T16:44:07.054199+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:07.054199+0000","last_undegraded":"2024-09-17T16:44:07.054199+0000","last_fullsized":"2024-09-17T16:44:07.054199+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:28.943300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:28.943300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:57.479658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":269,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-17T16:44:10.446195+0000","last_change":"2024-09-17T16:43:01.388637+0000","last_active":"2024-09-17T16:44:10.446195+0000","last_peered":"2024-09-17T16:44:10.446195+0000","last_clean":"2024-09-17T16:44:10.446195+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:10.446195+0000","last_undegraded":"2024-09-17T16:44:10.446195+0000","last_fullsized":"2024-09-17T16:44:10.446195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:01.388565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:01.388565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:27.089532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:07.410022+0000","last_change":"2024-09-17T16:44:07.409977+0000","last_active":"2024-09-17T16:44:07.410022+0000","last_peered":"2024-09-17T16:44:07.410022+0000","last_clean":"2024-09-17T16:44:07.410022+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:07.410022+0000","last_undegraded":"2024-09-17T16:44:07.410022+0000","last_fullsized":"2024-09-17T16:44:07.410022+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:07.409917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.409917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:36.281067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T16:44:06.816965+0000","last_change":"2024-09-17T16:43:51.873562+0000","last_active":"2024-09-17T16:44:06.816965+0000","last_peered":"2024-09-17T16:44:06.816965+0000","last_clean":"2024-09-17T16:44:06.816965+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:06.816965+0000","last_undegraded":"2024-09-17T16:44:06.816965+0000","last_fullsized":"2024-09-17T16:44:06.816965+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:24.703829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182434,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182434,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51028,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320812,"statfs":{"total":96636764160,"available":96584511488,"internally_reserved":0,"allocated":1826816,"data_stored":1888063,"data_compressed":266517,"data_compressed_allocated":552960,"data_compressed_original":1564672,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32920,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1789952,"data_stored":1359154,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280544,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1826816,"data_stored":1878448,"data_compressed":263632,"data_compressed_allocated":548864,"data_compressed_original":1544192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280544,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313249,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28768,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343072,"statfs":{"total":96636764160,"available":96607305728,"internally_reserved":0,"allocated":1773568,"data_stored":1349520,"data_compressed":257180,"data_compressed_allocated":516096,"data_compressed_original":1032192,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50980,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320860,"statfs":{"total":96636764160,"available":96584560640,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215136,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50992,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1798144,"data_stored":1368792,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215138,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55160,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316680,"statfs":{"total":96636764160,"available":96580280320,"internally_reserved":0,"allocated":1802240,"data_stored":1368811,"data_compressed":261312,"data_compressed_allocated":524288,"data_compressed_original":1048576,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182434,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32896,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1748992,"data_stored":1330290,"data_compressed":253050,"data_compressed_allocated":507904,"data_compressed_original":1015808,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182432,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1785856,"data_stored":1359135,"data_compressed":259246,"data_compressed_allocated":520192,"data_compressed_original":1040384,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:13.024 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T16:44:13.325 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:13.326 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":153,"fsid":"a18a1a02-ea8d-4573-a275-cb30a154e84c","created":"2024-09-17T16:41:30.645147+0000","modified":"2024-09-17T16:44:10.833581+0000","last_up_change":"2024-09-17T16:41:45.664856+0000","last_in_change":"2024-09-17T16:43:17.447861+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T16:41:43.059025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T16:41:53.164635+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":30,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3.9700000286102295,"score_stable":3.9700000286102295,"optimal_score":0.62999999523162842,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c580007f-04f5-4607-bcb0-9eca9fb6a273","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6817","nonce":360852295}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6819","nonce":360852295}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6823","nonce":360852295}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":360852295},{"type":"v1","addr":"172.21.15.60:6821","nonce":360852295}]},"public_addr":"172.21.15.60:6817/360852295","cluster_addr":"172.21.15.60:6819/360852295","heartbeat_back_addr":"172.21.15.60:6823/360852295","heartbeat_front_addr":"172.21.15.60:6821/360852295","state":["exists","up"]},{"osd":1,"uuid":"5068e4a5-399f-472d-bf4d-0105adfba800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6825","nonce":2001248690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6827","nonce":2001248690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6831","nonce":2001248690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":2001248690},{"type":"v1","addr":"172.21.15.98:6829","nonce":2001248690}]},"public_addr":"172.21.15.98:6825/2001248690","cluster_addr":"172.21.15.98:6827/2001248690","heartbeat_back_addr":"172.21.15.98:6831/2001248690","heartbeat_front_addr":"172.21.15.98:6829/2001248690","state":["exists","up"]},{"osd":2,"uuid":"5c9fdb5b-2bef-40bc-a82f-8b2d1e375e8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6809","nonce":1107977430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6811","nonce":1107977430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6815","nonce":1107977430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":1107977430},{"type":"v1","addr":"172.21.15.111:6813","nonce":1107977430}]},"public_addr":"172.21.15.111:6809/1107977430","cluster_addr":"172.21.15.111:6811/1107977430","heartbeat_back_addr":"172.21.15.111:6815/1107977430","heartbeat_front_addr":"172.21.15.111:6813/1107977430","state":["exists","up"]},{"osd":3,"uuid":"e00f6dc3-b74d-441a-abff-55ed4fba87a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6827","nonce":3360497893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6829","nonce":3360497893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6833","nonce":3360497893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":3360497893},{"type":"v1","addr":"172.21.15.183:6831","nonce":3360497893}]},"public_addr":"172.21.15.183:6827/3360497893","cluster_addr":"172.21.15.183:6829/3360497893","heartbeat_back_addr":"172.21.15.183:6833/3360497893","heartbeat_front_addr":"172.21.15.183:6831/3360497893","state":["exists","up"]},{"osd":4,"uuid":"7d0041d5-389e-4b11-b8e1-535c6113a4f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6825","nonce":3686363495}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6827","nonce":3686363495}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6831","nonce":3686363495}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3686363495},{"type":"v1","addr":"172.21.15.60:6829","nonce":3686363495}]},"public_addr":"172.21.15.60:6825/3686363495","cluster_addr":"172.21.15.60:6827/3686363495","heartbeat_back_addr":"172.21.15.60:6831/3686363495","heartbeat_front_addr":"172.21.15.60:6829/3686363495","state":["exists","up"]},{"osd":5,"uuid":"9fc5ba03-7465-43f6-a148-fcecb32304a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6801","nonce":3943188618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6803","nonce":3943188618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6807","nonce":3943188618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":3943188618},{"type":"v1","addr":"172.21.15.98:6805","nonce":3943188618}]},"public_addr":"172.21.15.98:6801/3943188618","cluster_addr":"172.21.15.98:6803/3943188618","heartbeat_back_addr":"172.21.15.98:6807/3943188618","heartbeat_front_addr":"172.21.15.98:6805/3943188618","state":["exists","up"]},{"osd":6,"uuid":"2f2be94b-f485-485b-9d16-80f293b0274c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6801","nonce":2604225407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6803","nonce":2604225407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6807","nonce":2604225407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2604225407},{"type":"v1","addr":"172.21.15.111:6805","nonce":2604225407}]},"public_addr":"172.21.15.111:6801/2604225407","cluster_addr":"172.21.15.111:6803/2604225407","heartbeat_back_addr":"172.21.15.111:6807/2604225407","heartbeat_front_addr":"172.21.15.111:6805/2604225407","state":["exists","up"]},{"osd":7,"uuid":"eedf3336-c9e3-4c8c-b81a-2f0ebfad326c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6819","nonce":462795917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6821","nonce":462795917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6825","nonce":462795917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":462795917},{"type":"v1","addr":"172.21.15.183:6823","nonce":462795917}]},"public_addr":"172.21.15.183:6819/462795917","cluster_addr":"172.21.15.183:6821/462795917","heartbeat_back_addr":"172.21.15.183:6825/462795917","heartbeat_front_addr":"172.21.15.183:6823/462795917","state":["exists","up"]},{"osd":8,"uuid":"44e1f674-128a-4388-a488-ffdec5ab479a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6801","nonce":680830956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6803","nonce":680830956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6807","nonce":680830956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":680830956},{"type":"v1","addr":"172.21.15.60:6805","nonce":680830956}]},"public_addr":"172.21.15.60:6801/680830956","cluster_addr":"172.21.15.60:6803/680830956","heartbeat_back_addr":"172.21.15.60:6807/680830956","heartbeat_front_addr":"172.21.15.60:6805/680830956","state":["exists","up"]},{"osd":9,"uuid":"c085e6d8-5929-4ab1-826e-cecb51ed73cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6809","nonce":2482839491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6811","nonce":2482839491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6815","nonce":2482839491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":2482839491},{"type":"v1","addr":"172.21.15.98:6813","nonce":2482839491}]},"public_addr":"172.21.15.98:6809/2482839491","cluster_addr":"172.21.15.98:6811/2482839491","heartbeat_back_addr":"172.21.15.98:6815/2482839491","heartbeat_front_addr":"172.21.15.98:6813/2482839491","state":["exists","up"]},{"osd":10,"uuid":"87248b6a-e219-48a5-911c-4995588e51a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6817","nonce":598689172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6819","nonce":598689172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6823","nonce":598689172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":598689172},{"type":"v1","addr":"172.21.15.111:6821","nonce":598689172}]},"public_addr":"172.21.15.111:6817/598689172","cluster_addr":"172.21.15.111:6819/598689172","heartbeat_back_addr":"172.21.15.111:6823/598689172","heartbeat_front_addr":"172.21.15.111:6821/598689172","state":["exists","up"]},{"osd":11,"uuid":"21b3d129-c96b-4240-aaaf-682d06b10e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6803","nonce":2000091361}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6805","nonce":2000091361}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6809","nonce":2000091361}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":2000091361},{"type":"v1","addr":"172.21.15.183:6807","nonce":2000091361}]},"public_addr":"172.21.15.183:6803/2000091361","cluster_addr":"172.21.15.183:6805/2000091361","heartbeat_back_addr":"172.21.15.183:6809/2000091361","heartbeat_front_addr":"172.21.15.183:6807/2000091361","state":["exists","up"]},{"osd":12,"uuid":"953f99d2-c3d1-4bac-b9c7-7f56bed3a05f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6809","nonce":1039497225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6811","nonce":1039497225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6815","nonce":1039497225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1039497225},{"type":"v1","addr":"172.21.15.60:6813","nonce":1039497225}]},"public_addr":"172.21.15.60:6809/1039497225","cluster_addr":"172.21.15.60:6811/1039497225","heartbeat_back_addr":"172.21.15.60:6815/1039497225","heartbeat_front_addr":"172.21.15.60:6813/1039497225","state":["exists","up"]},{"osd":13,"uuid":"a4d32ef9-7344-4d6e-a16c-8cc8623b23a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6817","nonce":2084737149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6819","nonce":2084737149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6823","nonce":2084737149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":2084737149},{"type":"v1","addr":"172.21.15.98:6821","nonce":2084737149}]},"public_addr":"172.21.15.98:6817/2084737149","cluster_addr":"172.21.15.98:6819/2084737149","heartbeat_back_addr":"172.21.15.98:6823/2084737149","heartbeat_front_addr":"172.21.15.98:6821/2084737149","state":["exists","up"]},{"osd":14,"uuid":"9305c16f-a01d-4eb1-95ff-df3616720e1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6825","nonce":3233790125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6827","nonce":3233790125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6831","nonce":3233790125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":3233790125},{"type":"v1","addr":"172.21.15.111:6829","nonce":3233790125}]},"public_addr":"172.21.15.111:6825/3233790125","cluster_addr":"172.21.15.111:6827/3233790125","heartbeat_back_addr":"172.21.15.111:6831/3233790125","heartbeat_front_addr":"172.21.15.111:6829/3233790125","state":["exists","up"]},{"osd":15,"uuid":"9a0ea790-a644-426d-baa7-35a2699a2123","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6811","nonce":2101706733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6813","nonce":2101706733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6817","nonce":2101706733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":2101706733},{"type":"v1","addr":"172.21.15.183:6815","nonce":2101706733}]},"public_addr":"172.21.15.183:6811/2101706733","cluster_addr":"172.21.15.183:6813/2101706733","heartbeat_back_addr":"172.21.15.183:6817/2101706733","heartbeat_front_addr":"172.21.15.183:6815/2101706733","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:09.428020+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:56.443024+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:03.553201+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.139316+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:59.621144+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:59.403015+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:44:10.688259+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:10.319477+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:51.340953+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:08.967734+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.457055+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:44:10.609432+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:54.548588+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:44:09.109651+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:43:46.531494+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T16:42:58.031579+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[11,4]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":38,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T16:44:14.340 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T16:44:14.340 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:14.482 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:14.482 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:14.482 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:14.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T16:44:14.791 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T16:44:14.804 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T16:44:14.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:14.932 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:14.932 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:14.933 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:14.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T16:44:15.244 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T16:44:15.256 INFO:tasks.ceph:Scrubbing osd.8 2024-09-17T16:44:15.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:15.385 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:15.385 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:15.385 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:15.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-09-17T16:44:15.696 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 8 to deep-scrub 2024-09-17T16:44:15.709 INFO:tasks.ceph:Scrubbing osd.12 2024-09-17T16:44:15.709 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:15.837 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:15.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2024-09-17T16:44:16.147 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 12 to deep-scrub 2024-09-17T16:44:16.160 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T16:44:16.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:16.290 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:16.290 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:16.290 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:16.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T16:44:16.603 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T16:44:16.616 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T16:44:16.617 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:16.745 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:16.745 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:16.745 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:16.756 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T16:44:17.069 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T16:44:17.082 INFO:tasks.ceph:Scrubbing osd.9 2024-09-17T16:44:17.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:17.212 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:17.212 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:17.212 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:17.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-09-17T16:44:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 9 to deep-scrub 2024-09-17T16:44:17.536 INFO:tasks.ceph:Scrubbing osd.13 2024-09-17T16:44:17.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:17.665 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:17.666 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:17.666 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:17.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2024-09-17T16:44:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 13 to deep-scrub 2024-09-17T16:44:17.990 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T16:44:17.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:18.120 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:18.120 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:18.120 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:18.130 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T16:44:18.432 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T16:44:18.445 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T16:44:18.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:18.573 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:18.574 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:18.574 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:18.584 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T16:44:18.885 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T16:44:18.899 INFO:tasks.ceph:Scrubbing osd.10 2024-09-17T16:44:18.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:19.028 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:19.028 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:19.028 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:19.039 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-09-17T16:44:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 10 to deep-scrub 2024-09-17T16:44:19.353 INFO:tasks.ceph:Scrubbing osd.14 2024-09-17T16:44:19.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:19.481 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:19.481 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:19.481 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:19.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2024-09-17T16:44:19.795 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 14 to deep-scrub 2024-09-17T16:44:19.808 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T16:44:19.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:19.939 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:19.939 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:19.939 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:19.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T16:44:20.251 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T16:44:20.265 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T16:44:20.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:20.394 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:20.394 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:20.394 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:20.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T16:44:20.706 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T16:44:20.719 INFO:tasks.ceph:Scrubbing osd.11 2024-09-17T16:44:20.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:20.848 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:20.848 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:20.859 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-09-17T16:44:21.164 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 11 to deep-scrub 2024-09-17T16:44:21.177 INFO:tasks.ceph:Scrubbing osd.15 2024-09-17T16:44:21.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2024-09-17T16:44:21.306 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-17T16:44:21.306 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T16:44:21.306 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-17T16:44:21.316 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2024-09-17T16:44:21.616 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 15 to deep-scrub 2024-09-17T16:44:21.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:22.742 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:22.757 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2024-09-17T16:44:21.887151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":617956,"kb_used_data":28688,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509331484,"statfs":{"total":1546188226560,"available":1545555439616,"internally_reserved":0,"allocated":29376512,"data_stored":23356803,"data_compressed":4279248,"data_compressed_allocated":8622080,"data_compressed_original":18149376,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.813555"},"pg_stats":[{"pgid":"1.0","version":"24'92","reported_seq":279,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:17.877198+0000","last_change":"2024-09-17T16:44:07.929732+0000","last_active":"2024-09-17T16:44:17.877198+0000","last_peered":"2024-09-17T16:44:17.877198+0000","last_clean":"2024-09-17T16:44:17.877198+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:17.877198+0000","last_undegraded":"2024-09-17T16:44:17.877198+0000","last_fullsized":"2024-09-17T16:44:17.877198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'92","last_scrub_stamp":"2024-09-17T16:44:07.929630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:43.656540+0000","last_clean_scrub_stamp":"2024-09-17T16:44:07.929630+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:33.953343+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"28'1","reported_seq":275,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:17.877219+0000","last_change":"2024-09-17T16:43:24.915167+0000","last_active":"2024-09-17T16:44:17.877219+0000","last_peered":"2024-09-17T16:44:17.877219+0000","last_clean":"2024-09-17T16:44:17.877219+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:17.877219+0000","last_undegraded":"2024-09-17T16:44:17.877219+0000","last_fullsized":"2024-09-17T16:44:17.877219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-09-17T16:43:24.915105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.915105+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:36.036662+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":272,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T16:44:16.958568+0000","last_change":"2024-09-17T16:44:14.202065+0000","last_active":"2024-09-17T16:44:16.958568+0000","last_peered":"2024-09-17T16:44:16.958568+0000","last_clean":"2024-09-17T16:44:16.958568+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:16.958568+0000","last_undegraded":"2024-09-17T16:44:16.958568+0000","last_fullsized":"2024-09-17T16:44:16.958568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:14.201987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:14.201987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:24.110183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":269,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:18.029327+0000","last_change":"2024-09-17T16:44:10.287817+0000","last_active":"2024-09-17T16:44:18.029327+0000","last_peered":"2024-09-17T16:44:18.029327+0000","last_clean":"2024-09-17T16:44:18.029327+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:18.029327+0000","last_undegraded":"2024-09-17T16:44:18.029327+0000","last_fullsized":"2024-09-17T16:44:18.029327+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:10.287742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:44:10.287742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:35.584866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"30'2","reported_seq":70,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:18.029169+0000","last_change":"2024-09-17T16:43:51.720905+0000","last_active":"2024-09-17T16:44:18.029169+0000","last_peered":"2024-09-17T16:44:18.029169+0000","last_clean":"2024-09-17T16:44:18.029169+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:18.029169+0000","last_undegraded":"2024-09-17T16:44:18.029169+0000","last_fullsized":"2024-09-17T16:44:18.029169+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-09-17T16:43:24.563571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:24.563571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:33.061636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":182,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:17.877211+0000","last_change":"2024-09-17T16:43:28.943379+0000","last_active":"2024-09-17T16:44:17.877211+0000","last_peered":"2024-09-17T16:44:17.877211+0000","last_clean":"2024-09-17T16:44:17.877211+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:17.877211+0000","last_undegraded":"2024-09-17T16:44:17.877211+0000","last_fullsized":"2024-09-17T16:44:17.877211+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:28.943300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:28.943300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:57.479658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":283,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:19.604717+0000","last_change":"2024-09-17T16:44:19.604717+0000","last_active":"2024-09-17T16:44:19.604717+0000","last_peered":"2024-09-17T16:44:19.604717+0000","last_clean":"2024-09-17T16:44:19.604717+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:19.604717+0000","last_undegraded":"2024-09-17T16:44:19.604717+0000","last_fullsized":"2024-09-17T16:44:19.604717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:19.604610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:19.604610+0000","last_clean_scrub_stamp":"2024-09-17T16:44:19.604610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:30.134267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":278,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-17T16:44:16.956925+0000","last_change":"2024-09-17T16:44:16.317516+0000","last_active":"2024-09-17T16:44:16.956925+0000","last_peered":"2024-09-17T16:44:16.956925+0000","last_clean":"2024-09-17T16:44:16.956925+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:16.956925+0000","last_undegraded":"2024-09-17T16:44:16.956925+0000","last_fullsized":"2024-09-17T16:44:16.956925+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:16.317451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:16.317451+0000","last_clean_scrub_stamp":"2024-09-17T16:44:16.317451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:32.603208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":119,"reported_epoch":155,"state":"active+clean","last_fresh":"2024-09-17T16:44:18.029168+0000","last_change":"2024-09-17T16:43:51.873562+0000","last_active":"2024-09-17T16:44:18.029168+0000","last_peered":"2024-09-17T16:44:18.029168+0000","last_clean":"2024-09-17T16:44:18.029168+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:18.029168+0000","last_undegraded":"2024-09-17T16:44:18.029168+0000","last_fullsized":"2024-09-17T16:44:18.029168+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:43:16.850184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:41:54.100364+0000","last_clean_scrub_stamp":"2024-09-17T16:43:16.850184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:44:24.703829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182437,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32980,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182437,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51072,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320768,"statfs":{"total":96636764160,"available":96584466432,"internally_reserved":0,"allocated":1875968,"data_stored":1926841,"data_compressed":274768,"data_compressed_allocated":569344,"data_compressed_original":1597440,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280546,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1810432,"data_stored":1378499,"data_compressed":263375,"data_compressed_allocated":528384,"data_compressed_original":1056768,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1826816,"data_stored":1388275,"data_compressed":265436,"data_compressed_allocated":532480,"data_compressed_original":1064960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33020,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338820,"statfs":{"total":96636764160,"available":96602951680,"internally_reserved":0,"allocated":1875968,"data_stored":1917184,"data_compressed":271888,"data_compressed_allocated":565248,"data_compressed_original":1576960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1822720,"data_stored":1388256,"data_compressed":265436,"data_compressed_allocated":532480,"data_compressed_original":1064960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313251,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32968,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338872,"statfs":{"total":96636764160,"available":96603004928,"internally_reserved":0,"allocated":1822720,"data_stored":1388256,"data_compressed":265436,"data_compressed_allocated":532480,"data_compressed_original":1064960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313251,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28808,"kb_used_data":1780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343032,"statfs":{"total":96636764160,"available":96607264768,"internally_reserved":0,"allocated":1822720,"data_stored":1388256,"data_compressed":265436,"data_compressed_allocated":532480,"data_compressed_original":1064960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247844,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51032,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320808,"statfs":{"total":96636764160,"available":96584507392,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215138,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32984,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215141,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51024,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320816,"statfs":{"total":96636764160,"available":96584515584,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51032,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320808,"statfs":{"total":96636764160,"available":96584507392,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215140,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55188,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316652,"statfs":{"total":96636764160,"available":96580251648,"internally_reserved":0,"allocated":1839104,"data_stored":1397932,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182437,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32984,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182435,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32984,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338856,"statfs":{"total":96636764160,"available":96602988544,"internally_reserved":0,"allocated":1835008,"data_stored":1397913,"data_compressed":267497,"data_compressed_allocated":536576,"data_compressed_original":1073152,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:22.761 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T16:44:07.929630+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=7, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:44:22.762 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T16:43:24.915105+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=43, tm_sec=24, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:44:22.762 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T16:44:10.287742+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=10, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:44:22.762 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T16:43:24.563571+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=43, tm_sec=24, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:44:22.762 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T16:43:28.943300+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=43, tm_sec=28, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:44:22.762 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T16:43:16.850184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=43, tm_sec=16, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=16, tm_min=44, tm_sec=13, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T16:44:22.762 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T16:44:42.763 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T16:44:43.075 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-17T16:44:43.075 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-17T16:44:43.087 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-17T16:44:41.079930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":125,"num_write_kb":2152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":528947,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":618812,"kb_used_data":29540,"kb_used_omap":24,"kb_used_meta":588903,"kb_avail":1509330628,"statfs":{"total":1546188226560,"available":1545554563072,"internally_reserved":0,"allocated":30248960,"data_stored":24043350,"data_compressed":4425659,"data_compressed_allocated":8912896,"data_compressed_original":18731008,"omap_allocated":25521,"internal_metadata":603036751},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003134"},"pg_stats":[{"pgid":"1.0","version":"157'94","reported_seq":297,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:26.907962+0000","last_change":"2024-09-17T16:44:23.987368+0000","last_active":"2024-09-17T16:44:26.907962+0000","last_peered":"2024-09-17T16:44:26.907962+0000","last_clean":"2024-09-17T16:44:26.907962+0000","last_became_active":"2024-09-17T16:41:46.674021+0000","last_became_peered":"2024-09-17T16:41:46.674021+0000","last_unstale":"2024-09-17T16:44:26.907962+0000","last_undegraded":"2024-09-17T16:44:26.907962+0000","last_fullsized":"2024-09-17T16:44:26.907962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"157'94","last_scrub_stamp":"2024-09-17T16:44:23.987276+0000","last_deep_scrub":"157'94","last_deep_scrub_stamp":"2024-09-17T16:44:23.987276+0000","last_clean_scrub_stamp":"2024-09-17T16:44:23.987276+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:29.248780+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.3","version":"155'2","reported_seq":292,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:26.907973+0000","last_change":"2024-09-17T16:44:22.968016+0000","last_active":"2024-09-17T16:44:26.907973+0000","last_peered":"2024-09-17T16:44:26.907973+0000","last_clean":"2024-09-17T16:44:26.907973+0000","last_became_active":"2024-09-17T16:41:55.132887+0000","last_became_peered":"2024-09-17T16:41:55.132887+0000","last_unstale":"2024-09-17T16:44:26.907973+0000","last_undegraded":"2024-09-17T16:44:26.907973+0000","last_fullsized":"2024-09-17T16:44:26.907973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'2","last_scrub_stamp":"2024-09-17T16:44:22.967923+0000","last_deep_scrub":"155'2","last_deep_scrub_stamp":"2024-09-17T16:44:22.967923+0000","last_clean_scrub_stamp":"2024-09-17T16:44:22.967923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:29.887858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00040974099999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":290,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:27.132501+0000","last_change":"2024-09-17T16:44:18.226070+0000","last_active":"2024-09-17T16:44:27.132501+0000","last_peered":"2024-09-17T16:44:27.132501+0000","last_clean":"2024-09-17T16:44:27.132501+0000","last_became_active":"2024-09-17T16:41:55.116727+0000","last_became_peered":"2024-09-17T16:41:55.116727+0000","last_unstale":"2024-09-17T16:44:27.132501+0000","last_undegraded":"2024-09-17T16:44:27.132501+0000","last_fullsized":"2024-09-17T16:44:27.132501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:18.225945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:18.225945+0000","last_clean_scrub_stamp":"2024-09-17T16:44:18.225945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:18.389738+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00037449800000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6],"acting":[9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":285,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:27.336622+0000","last_change":"2024-09-17T16:44:22.283486+0000","last_active":"2024-09-17T16:44:27.336622+0000","last_peered":"2024-09-17T16:44:27.336622+0000","last_clean":"2024-09-17T16:44:27.336622+0000","last_became_active":"2024-09-17T16:41:55.116845+0000","last_became_peered":"2024-09-17T16:41:55.116845+0000","last_unstale":"2024-09-17T16:44:27.336622+0000","last_undegraded":"2024-09-17T16:44:27.336622+0000","last_fullsized":"2024-09-17T16:44:27.336622+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:22.283400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:22.283400+0000","last_clean_scrub_stamp":"2024-09-17T16:44:22.283400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:32.435718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044181500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,11],"acting":[15,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.2","version":"155'3","reported_seq":87,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:26.909266+0000","last_change":"2024-09-17T16:44:19.921917+0000","last_active":"2024-09-17T16:44:26.909266+0000","last_peered":"2024-09-17T16:44:26.909266+0000","last_clean":"2024-09-17T16:44:26.909266+0000","last_became_active":"2024-09-17T16:43:51.720652+0000","last_became_peered":"2024-09-17T16:43:51.720652+0000","last_unstale":"2024-09-17T16:44:26.909266+0000","last_undegraded":"2024-09-17T16:44:26.909266+0000","last_fullsized":"2024-09-17T16:44:26.909266+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"155'3","last_scrub_stamp":"2024-09-17T16:44:19.921823+0000","last_deep_scrub":"155'3","last_deep_scrub_stamp":"2024-09-17T16:44:19.921823+0000","last_clean_scrub_stamp":"2024-09-17T16:44:19.921823+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:40.156082+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,12],"acting":[13,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:26.907970+0000","last_change":"2024-09-17T16:44:21.950550+0000","last_active":"2024-09-17T16:44:26.907970+0000","last_peered":"2024-09-17T16:44:26.907970+0000","last_clean":"2024-09-17T16:44:26.907970+0000","last_became_active":"2024-09-17T16:42:45.449417+0000","last_became_peered":"2024-09-17T16:42:45.449417+0000","last_unstale":"2024-09-17T16:44:26.907970+0000","last_undegraded":"2024-09-17T16:44:26.907970+0000","last_fullsized":"2024-09-17T16:44:26.907970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:21.950468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:21.950468+0000","last_clean_scrub_stamp":"2024-09-17T16:44:21.950468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:41.754162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":291,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:27.510436+0000","last_change":"2024-09-17T16:44:19.604717+0000","last_active":"2024-09-17T16:44:27.510436+0000","last_peered":"2024-09-17T16:44:27.510436+0000","last_clean":"2024-09-17T16:44:27.510436+0000","last_became_active":"2024-09-17T16:41:55.116540+0000","last_became_peered":"2024-09-17T16:41:55.116540+0000","last_unstale":"2024-09-17T16:44:27.510436+0000","last_undegraded":"2024-09-17T16:44:27.510436+0000","last_fullsized":"2024-09-17T16:44:27.510436+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:19.604610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:19.604610+0000","last_clean_scrub_stamp":"2024-09-17T16:44:19.604610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:30.134267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057032999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":288,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:27.510746+0000","last_change":"2024-09-17T16:44:16.317516+0000","last_active":"2024-09-17T16:44:27.510746+0000","last_peered":"2024-09-17T16:44:27.510746+0000","last_clean":"2024-09-17T16:44:27.510746+0000","last_became_active":"2024-09-17T16:41:55.116328+0000","last_became_peered":"2024-09-17T16:41:55.116328+0000","last_unstale":"2024-09-17T16:44:27.510746+0000","last_undegraded":"2024-09-17T16:44:27.510746+0000","last_fullsized":"2024-09-17T16:44:27.510746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:16.317451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:16.317451+0000","last_clean_scrub_stamp":"2024-09-17T16:44:16.317451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:32.603208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033462800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":135,"reported_epoch":159,"state":"active+clean","last_fresh":"2024-09-17T16:44:26.909276+0000","last_change":"2024-09-17T16:44:18.895309+0000","last_active":"2024-09-17T16:44:26.909276+0000","last_peered":"2024-09-17T16:44:26.909276+0000","last_clean":"2024-09-17T16:44:26.909276+0000","last_became_active":"2024-09-17T16:43:51.873308+0000","last_became_peered":"2024-09-17T16:43:51.873308+0000","last_unstale":"2024-09-17T16:44:26.909276+0000","last_undegraded":"2024-09-17T16:44:26.909276+0000","last_fullsized":"2024-09-17T16:44:26.909276+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T16:44:18.895231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T16:44:18.895231+0000","last_clean_scrub_stamp":"2024-09-17T16:44:18.895231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T16:45:28.160383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":528928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1057856,"data_compressed":13723,"data_compressed_allocated":65536,"data_compressed_original":1036288,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":25,"seq":107374182440,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,5,6,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":25,"seq":107374182440,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,5,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":25,"seq":107374182440,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51116,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320724,"statfs":{"total":96636764160,"available":96584421376,"internally_reserved":0,"allocated":1925120,"data_stored":1965519,"data_compressed":283017,"data_compressed_allocated":585728,"data_compressed_original":1630208,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,4,5,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":22,"seq":94489280550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,5,6,7,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1888256,"data_stored":1436610,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280550,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33080,"kb_used_data":1892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338760,"statfs":{"total":96636764160,"available":96602890240,"internally_reserved":0,"allocated":1937408,"data_stored":1965519,"data_compressed":282198,"data_compressed_allocated":585728,"data_compressed_original":1617920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":22,"seq":94489280550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,5,6,7,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313255,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,6,7,9,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313255,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28872,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342968,"statfs":{"total":96636764160,"available":96607199232,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,4,5,6,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":23,"seq":98784247849,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51084,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320756,"statfs":{"total":96636764160,"available":96584454144,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,4,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":24,"seq":103079215142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":24,"seq":103079215145,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51080,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320760,"statfs":{"total":96636764160,"available":96584458240,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[2,4,5,7,8,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":24,"seq":103079215144,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51076,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320764,"statfs":{"total":96636764160,"available":96584462336,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[2,4,5,6,7,8,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":24,"seq":103079215144,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55240,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316600,"statfs":{"total":96636764160,"available":96580198400,"internally_reserved":0,"allocated":1888256,"data_stored":1436610,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,4,5,6,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182440,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33028,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338812,"statfs":{"total":96636764160,"available":96602943488,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":25,"seq":107374182438,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":1436591,"data_compressed":275746,"data_compressed_allocated":552960,"data_compressed_original":1105920,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6452,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":7271,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T16:44:43.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T16:44:43.403 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T16:44:43.403 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T16:44:43.403 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T16:44:43.403 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.431 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T16:44:43.431 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T16:44:43.432 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.503 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T16:44:43.503 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-09-17T16:44:43.504 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.573 INFO:tasks.ceph.osd.8:Stopped 2024-09-17T16:44:43.573 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-09-17T16:44:43.573 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.646 INFO:tasks.ceph.osd.12:Stopped 2024-09-17T16:44:43.647 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T16:44:43.647 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.691 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T16:44:43.691 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T16:44:43.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.727 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T16:44:43.727 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-09-17T16:44:43.727 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.804 INFO:tasks.ceph.osd.9:Stopped 2024-09-17T16:44:43.804 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2024-09-17T16:44:43.804 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.871 INFO:tasks.ceph.osd.13:Stopped 2024-09-17T16:44:43.872 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T16:44:43.872 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.914 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T16:44:43.914 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T16:44:43.914 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:43.957 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T16:44:43.957 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-09-17T16:44:43.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.002 INFO:tasks.ceph.osd.10:Stopped 2024-09-17T16:44:44.002 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-09-17T16:44:44.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.049 INFO:tasks.ceph.osd.14:Stopped 2024-09-17T16:44:44.050 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T16:44:44.050 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.086 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T16:44:44.087 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T16:44:44.087 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.165 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T16:44:44.165 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-09-17T16:44:44.165 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.240 INFO:tasks.ceph.osd.11:Stopped 2024-09-17T16:44:44.240 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2024-09-17T16:44:44.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.313 INFO:tasks.ceph.osd.15:Stopped 2024-09-17T16:44:44.313 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T16:44:44.314 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T16:44:44.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.340 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T16:44:44.340 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T16:44:44.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.385 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T16:44:44.386 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T16:44:44.386 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T16:44:44.386 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.398 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T16:44:44.398 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T16:44:44.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.412 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T16:44:44.413 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T16:44:44.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T16:44:44.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 is failed for ~0s 2024-09-17T16:44:44.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2024-09-17T16:44:44.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-17T16:44:44.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-17T16:44:44.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-17T16:44:44.428 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T16:44:44.428 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T16:44:44.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'slow request' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-17T16:44:44.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:44:44.477 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T16:44:44.681 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:44:44.681 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T16:44:44.779 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:44:44.780 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-09-17T16:44:44.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:44:44.972 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2024-09-17T16:44:45.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:44:45.038 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T16:44:45.154 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:44:45.154 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T16:44:45.235 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:44:45.235 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-09-17T16:44:45.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:44:45.284 DEBUG:teuthology.orchestra.run.smithi098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2024-09-17T16:44:45.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:44:45.335 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T16:44:45.460 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:44:45.461 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T16:44:45.560 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:44:45.560 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-09-17T16:44:45.624 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:44:45.625 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2024-09-17T16:44:45.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:44:45.690 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T16:44:45.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:44:45.885 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T16:44:45.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:44:45.972 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-09-17T16:44:46.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:44:46.031 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2024-09-17T16:44:46.088 INFO:tasks.ceph:Archiving mon data... 2024-09-17T16:44:46.090 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/data/mon.a.tgz 2024-09-17T16:44:46.090 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-17T16:44:46.111 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.umpDlXLq6u 2024-09-17T16:44:46.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.umpDlXLq6u 2024-09-17T16:44:46.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.umpDlXLq6u 2024-09-17T16:44:46.379 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.umpDlXLq6u is 438KB 2024-09-17T16:44:46.478 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.umpDlXLq6u 2024-09-17T16:44:46.494 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/data/mon.b.tgz 2024-09-17T16:44:46.494 DEBUG:teuthology.orchestra.run.smithi098:> mktemp 2024-09-17T16:44:46.513 INFO:teuthology.orchestra.run.smithi098.stdout:/tmp/tmp.SwEyDgxF0X 2024-09-17T16:44:46.513 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SwEyDgxF0X 2024-09-17T16:44:46.979 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 0666 /tmp/tmp.SwEyDgxF0X 2024-09-17T16:44:47.061 DEBUG:teuthology.orchestra.remote:smithi098:/tmp/tmp.SwEyDgxF0X is 601KB 2024-09-17T16:44:47.160 DEBUG:teuthology.orchestra.run.smithi098:> rm -fr /tmp/tmp.SwEyDgxF0X 2024-09-17T16:44:47.175 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/data/mon.c.tgz 2024-09-17T16:44:47.175 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-17T16:44:47.194 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.vZFEVSLkRa 2024-09-17T16:44:47.194 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.vZFEVSLkRa 2024-09-17T16:44:47.533 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.vZFEVSLkRa 2024-09-17T16:44:47.617 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.vZFEVSLkRa is 600KB 2024-09-17T16:44:47.716 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.vZFEVSLkRa 2024-09-17T16:44:47.731 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T16:44:47.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T16:44:47.734 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T16:44:47.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T16:44:47.772 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T16:44:47.822 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T16:44:47.838 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T16:44:47.853 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T16:44:47.871 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T16:44:47.872 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T16:44:47.873 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi060/crash 2024-09-17T16:44:47.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T16:44:47.904 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi098/crash 2024-09-17T16:44:47.905 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T16:44:47.931 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi111/crash 2024-09-17T16:44:47.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T16:44:47.957 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi183/crash 2024-09-17T16:44:47.958 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T16:44:48.091 INFO:tasks.ceph:Compressing logs... 2024-09-17T16:44:48.091 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T16:44:48.095 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T16:44:48.097 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T16:44:48.099 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T16:44:48.119 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T16:44:48.119 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-09-17T16:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2024-09-17T16:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T16:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T16:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T16:44:48.121 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T16:44:48.124 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.6.log: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T16:44:48.125 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T16:44:48.125 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T16:44:48.126 INFO:teuthology.orchestra.run.smithi098.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T16:44:48.144 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32851.log 2024-09-17T16:44:48.144 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-09-17T16:44:48.144 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.32851.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T16:44:48.144 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32851.log.gz 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32942.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.32942.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32942.log.gz 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33142.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz /var/log/ceph/ceph-client.admin.32895.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37221.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.15.log: /var/log/ceph/ceph-client.admin.32895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33422.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32895.log.gz 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.0.37221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33382.log 2024-09-17T16:44:48.145 INFO:teuthology.orchestra.run.smithi183.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.0.37221.log.gz 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33422.log.gz 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33062.log 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33382.log.gz 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33182.log 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33062.log.gz 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33102.log 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33182.log.gz 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-09-17T16:44:48.146 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33102.log.gz 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32982.log 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33022.log 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.32982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32982.log.gz 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33342.log 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33022.log.gz 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-client.admin.33342.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33342.log.gz 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32811.log 2024-09-17T16:44:48.147 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.32811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32811.log.gz 2024-09-17T16:44:48.207 INFO:teuthology.orchestra.run.smithi183.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T16:44:48.241 INFO:teuthology.orchestra.run.smithi111.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52249.log 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52249.log.gz 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50333.log 2024-09-17T16:44:48.245 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37440.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52585.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37440.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39196.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37936.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52585.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47201.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39196.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49689.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37936.log.gz 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52123.log 2024-09-17T16:44:48.246 INFO:teuthology.orchestra.run.smithi060.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.47201.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51745.log 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49689.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52123.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37465.log 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51745.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48175.log 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49721.log 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37465.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48175.log.gz 2024-09-17T16:44:48.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49721.log.gz 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52417.log 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46943.log 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49716.log 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52417.log.gz 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52207.log 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46943.log.gz 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37981.log 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49716.log.gz 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51955.log 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52207.log.gz 2024-09-17T16:44:48.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37981.log.gz 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51955.log.gz 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52081.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38607.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37984.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52081.log.gz 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38604.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38607.log.gz 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50919.log 2024-09-17T16:44:48.249 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37984.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44027.log 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38604.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52879.log 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50919.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33645.log 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44027.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49712.log 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52879.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50779.log 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33645.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52753.log 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49712.log.gz 2024-09-17T16:44:48.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51493.log 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50779.log.gz 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42495.log 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52753.log.gz 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49267.log 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51493.log.gz 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42906.log 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.42495.log.gz 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49729.log 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49267.log.gz 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50337.log 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.42906.log.gz 2024-09-17T16:44:48.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50337.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46851.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43598.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51535.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.46851.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40581.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr: 25.0% -- replaced with /var/log/ceph/ceph-client.admin.43598.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51787.log 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51535.log.gz 2024-09-17T16:44:48.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39154.log 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40581.log.gz 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51787.log.gz 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38464.log 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39154.log.gz 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48763.log 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38464.log.gz 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2024-09-17T16:44:48.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49686.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48763.log.gz 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49693.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39238.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49686.log.gz 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37642.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49693.log.gz 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46516.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39238.log.gz 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47781.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37642.log.gz 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-09-17T16:44:48.254 INFO:teuthology.orchestra.run.smithi060.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.46516.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47781.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48553.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42435.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48553.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38596.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38533.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42435.log.gz 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50334.log 2024-09-17T16:44:48.255 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38596.log.gz 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50330.log 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38533.log.gz 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49714.log 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50334.log.gz 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50330.log.gz 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53089.log 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49714.log.gz 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53129.log 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47436.log 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53089.log.gz 2024-09-17T16:44:48.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40073.log 0.0% 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53129.log.gz 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47436.log.gz 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50833.log 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40073.log.gz 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47677.log 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50833.log.gz 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47677.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz -5 2024-09-17T16:44:48.257 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42907.log 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42061.log 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42907.log.gz 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39028.log 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50283.log 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.42061.log.gz 2024-09-17T16:44:48.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39028.log.gz 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52501.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50339.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50283.log.gz 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52501.log.gz 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43038.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52291.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50339.log.gz 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52711.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43038.log.gz 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38612.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52291.log.gz 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38582.log 2024-09-17T16:44:48.261 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52711.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43514.log 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38612.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46451.log 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38582.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52627.log 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43514.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39465.log 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46451.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46337.log 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52627.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43441.log 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39465.log.gz 2024-09-17T16:44:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43399.log 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.46337.log.gz 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.43441.log.gz 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41644.log 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43399.log.gz 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46297.log 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41644.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr: 28.1% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47719.log 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46297.log.gz 2024-09-17T16:44:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50799.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47719.log.gz 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49309.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51044.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50799.log.gz 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49309.log.gz 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44696.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51044.log.gz 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48931.log 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44696.log.gz 2024-09-17T16:44:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38543.log 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42175.log 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48931.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48343.log 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38543.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40401.log 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.42175.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49099.log 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48343.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51997.log 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.40401.log.gz 2024-09-17T16:44:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37969.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49099.log.gz 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49057.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51997.log.gz 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37969.log.gz 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39742.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38662.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49057.log: 28.6% -- replaced with /var/log/ceph/ceph-client.admin.49057.log.gz 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53047.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39742.log.gz 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38662.log.gz 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52543.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51451.log 2024-09-17T16:44:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53047.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52543.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37959.log 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49393.log 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51451.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48301.log 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37959.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48427.log 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49393.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48301.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.48301.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48721.log 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39464.log 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48427.log.gz 2024-09-17T16:44:48.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48721.log.gz 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39464.log.gz 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41529.log 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38579.log 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40004.log 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41529.log.gz 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46255.log 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38579.log.gz 2024-09-17T16:44:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52669.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.40004.log.gz 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48385.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46255.log.gz 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43534.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52669.log.gz 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48385.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.48385.log.gz 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41170.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47559.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43534.log.gz 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41170.log.gz 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48217.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48595.log 2024-09-17T16:44:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47559.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.47559.log.gz 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48217.log.gz 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52963.log 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51189.log 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48595.log.gz 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52963.log.gz 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51829.log 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51913.log 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51189.log.gz 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51829.log.gz 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52837.log 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49728.log 2024-09-17T16:44:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51913.log.gz 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52837.log.gz 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49183.log 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45595.log 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49728.log.gz 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49183.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49183.log.gz 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49730.log 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45595.log: -- /var/log/ceph/ceph-client.admin.48091.log 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45595.log.gz 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49730.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49730.log.gz -5 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50340.log 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50509.log 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48091.log.gz 2024-09-17T16:44:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39070.log 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50340.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41686.log 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50509.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39070.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44873.log 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47963.log 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41686.log: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.41686.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51871.log 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44873.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42730.log 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47963.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51871.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51871.log.gz 2024-09-17T16:44:48.272 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38660.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44768.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42730.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.42730.log.gz 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48637.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38660.log.gz 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48027.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44768.log.gz 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45418.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48637.log.gz 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40516.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48027.log.gz 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2024-09-17T16:44:48.273 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45418.log.gz 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40516.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.40516.log.gz 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48259.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51199.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45594.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48259.log.gz 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51190.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51199.log.gz 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37960.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45594.log.gz 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51703.log 2024-09-17T16:44:48.274 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37950.log 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37960.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39918.log 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51703.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33913.log 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37950.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39918.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.33913.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33913.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52333.log 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50247.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2024-09-17T16:44:48.275 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49713.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52333.log.gz 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48026.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49713.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.49713.log.gz --verbose 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.37970.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37972.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48026.log.gz 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38538.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37970.log.gz 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41006.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37972.log.gz 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37977.log 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38538.log.gz 2024-09-17T16:44:48.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51577.log 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr: 23.5% -- replaced with /var/log/ceph/ceph-client.admin.41006.log.gz 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45017.log 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37977.log.gz 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47081.log 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51577.log.gz 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43953.log 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45017.log.gz 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52165.log 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47081.log.gz 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41959.log 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.43953.log.gz 2024-09-17T16:44:48.277 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37558.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52165.log: /var/log/ceph/ceph-client.admin.41959.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41959.log.gz 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52165.log.gz 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37558.log.gz 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46106.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48511.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46106.log: gzip -5 --verbose -- 24.5% -- replaced with /var/log/ceph/ceph-client.admin.46106.log.gz 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.49724.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48511.log.gz 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44872.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49225.log 2024-09-17T16:44:48.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47008.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52795.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49225.log: /var/log/ceph/ceph-client.admin.47008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48847.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49225.log.gz 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47008.log.gz 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52795.log: 0.0%/var/log/ceph/ceph-client.admin.48847.log: -- replaced with /var/log/ceph/ceph-client.admin.52795.log.gz 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51661.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48847.log.gz 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44067.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51661.log.gz 92.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51197.log 2024-09-17T16:44:48.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46944.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44067.log: 25.7% -- replaced with /var/log/ceph/ceph-client.admin.44067.log.gzgzip 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: -5 84.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51197.log: /var/log/ceph/ceph-client.admin.46944.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46944.log.gz 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51197.log.gz 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47876.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50341.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50404.log: /var/log/ceph/ceph-client.admin.47876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39462.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47876.log.gz 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42333.log 2024-09-17T16:44:48.280 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50341.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43286.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.39462.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34037.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42333.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43286.log: gzip -5 24.2% -- replaced with /var/log/ceph/ceph-client.admin.43286.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.34037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34037.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51619.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gz 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40631.log 2024-09-17T16:44:48.281 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51619.log.gz 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37961.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz --verbose 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.51200.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40631.log.gz 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51045.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51200.log.gz 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44497.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39112.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51045.log.gz 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47896.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44497.log.gz 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40752.log 2024-09-17T16:44:48.282 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39112.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48469.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47896.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50873.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.40752.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50123.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48469.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37384.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50873.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50123.log: -- /var/log/ceph/ceph-client.admin.45728.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50123.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37384.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-09-17T16:44:48.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42249.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40474.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38574.log: gzip/var/log/ceph/ceph-client.admin.42249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42249.log.gz 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.49141.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.40474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40474.log.gz 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50362.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49141.log: /var/log/ceph/ceph-client.admin.48133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51047.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49141.log.gz 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50362.log.gz 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48973.log 2024-09-17T16:44:48.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51047.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51047.log.gz 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.52375.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48973.log.gz 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43872.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52375.log.gz 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45353.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43872.log.gz 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50411.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50329.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50411.log.gz 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5/var/log/ceph/ceph-client.admin.50329.log: --verbose -- /var/log/ceph/ceph-client.admin.39280.log 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50329.log.gz/var/log/ceph/ceph-client.admin.37305.log: 2024-09-17T16:44:48.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.48805.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.39280.log: -- /var/log/ceph/ceph-client.admin.52459.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39280.log.gz 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48805.log.gz 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52921.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45354.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52459.log: /var/log/ceph/ceph-client.admin.52921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52459.log.gz 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52921.log.gz 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39845.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45354.log.gz 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37516.log 2024-09-17T16:44:48.286 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39845.log: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.39845.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27799.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37516.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37516.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44537.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.tmp-client.admin.27799.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.48889.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.27799.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44537.log: gzip -5 --verbose 24.8% -- replaced with /var/log/ceph/ceph-client.admin.44537.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.49695.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48889.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49735.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49695.log.gz 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48679.log 2024-09-17T16:44:48.287 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49735.log: /var/log/ceph/ceph-client.admin.47635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49735.log.gz 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48679.log.gz 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51188.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42998.log: /var/log/ceph/ceph-client.admin.39961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39342.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51188.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz -5 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47761.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38509.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.39342.log: /var/log/ceph/ceph-client.admin.47761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47456.log 2024-09-17T16:44:48.288 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39342.log.gz 24.9% -- replaced with /var/log/ceph/ceph-client.admin.47761.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38509.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37948.log 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47456.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47456.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38487.log 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37948.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38487.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41571.log 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37925.log 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41571.log: 24.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41571.log.gz 2024-09-17T16:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41376.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37925.log.gz 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49732.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37939.log: /var/log/ceph/ceph-client.admin.41376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52039.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.41376.log.gz 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49732.log: 27.8% -- replaced with /var/log/ceph/ceph-client.admin.49732.log.gz 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45458.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38625.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52039.log: /var/log/ceph/ceph-client.admin.45458.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52039.log.gz 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.40179.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.45458.log.gz 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41005.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.38625.log: /var/log/ceph/ceph-client.admin.40179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37600.log 2024-09-17T16:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38625.log.gz -- replaced with /var/log/ceph/ceph-client.admin.40179.log.gz 2024-09-17T16:44:48.291 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-17T16:44:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41005.log.gz 2024-09-17T16:44:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37973.log 2024-09-17T16:44:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37600.log.gz 2024-09-17T16:44:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.37973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37973.log.gz 2024-09-17T16:44:48.291 INFO:teuthology.orchestra.run.smithi098.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T16:44:48.477 INFO:teuthology.orchestra.run.smithi098.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-09-17T16:44:48.549 INFO:teuthology.orchestra.run.smithi060.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T16:44:48.616 INFO:teuthology.orchestra.run.smithi060.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T16:44:48.668 INFO:teuthology.orchestra.run.smithi098.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2024-09-17T16:44:48.709 INFO:teuthology.orchestra.run.smithi111.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T16:44:48.842 INFO:teuthology.orchestra.run.smithi060.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-09-17T16:44:48.844 INFO:teuthology.orchestra.run.smithi098.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T16:44:48.898 INFO:teuthology.orchestra.run.smithi183.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T16:44:48.903 INFO:teuthology.orchestra.run.smithi183.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T16:44:48.941 INFO:teuthology.orchestra.run.smithi183.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2024-09-17T16:44:48.957 INFO:teuthology.orchestra.run.smithi060.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T16:44:48.988 INFO:teuthology.orchestra.run.smithi060.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2024-09-17T16:44:48.990 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-17T16:44:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m0.879s 2024-09-17T16:44:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:user 0m3.149s 2024-09-17T16:44:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m0.263s 2024-09-17T16:44:48.993 INFO:teuthology.orchestra.run.smithi111.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-09-17T16:44:49.006 INFO:teuthology.orchestra.run.smithi111.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T16:44:49.034 INFO:teuthology.orchestra.run.smithi111.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2024-09-17T16:44:49.035 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-17T16:44:49.035 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m0.924s 2024-09-17T16:44:49.035 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m3.257s 2024-09-17T16:44:49.036 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m0.134s 2024-09-17T16:44:49.161 INFO:teuthology.orchestra.run.smithi183.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-09-17T16:44:49.163 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-09-17T16:44:49.163 INFO:teuthology.orchestra.run.smithi183.stderr:real 0m1.048s 2024-09-17T16:44:49.163 INFO:teuthology.orchestra.run.smithi183.stderr:user 0m3.358s 2024-09-17T16:44:49.164 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m0.137s 2024-09-17T16:44:49.198 INFO:teuthology.orchestra.run.smithi098.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T16:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-17T16:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m1.091s 2024-09-17T16:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m2.779s 2024-09-17T16:44:49.200 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.104s 2024-09-17T16:44:49.201 INFO:tasks.ceph:Archiving logs... 2024-09-17T16:44:49.201 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi060/log 2024-09-17T16:44:49.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T16:44:49.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.11 has been restored 2024-09-17T16:44:49.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2024-09-17T16:44:49.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-17T16:44:49.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-17T16:44:49.429 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-17T16:44:49.913 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi098/log 2024-09-17T16:44:49.914 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T16:44:50.404 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi111/log 2024-09-17T16:44:50.405 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T16:44:50.937 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi183/log 2024-09-17T16:44:50.938 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T16:44:51.492 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T16:44:51.503 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T16:44:51.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T16:44:51.506 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T16:44:51.508 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T16:44:51.511 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T16:44:51.622 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T16:44:51.633 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T16:44:51.634 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:44:51.637 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:44:51.639 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:44:51.641 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T16:44:51.652 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:44:51.654 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:44:51.656 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:44:51.657 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:44:51.657 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-17T16:44:51.657 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +152us[ +158us] +/- 50ms 2024-09-17T16:44:51.657 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +219us[ +225us] +/- 55ms 2024-09-17T16:44:51.657 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -645us[ -639us] +/- 90ms 2024-09-17T16:44:51.657 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:44:51.658 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-09-17T16:44:51.659 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:44:51.659 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-17T16:44:51.659 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +149us[ +165us] +/- 50ms 2024-09-17T16:44:51.659 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +232us[ +248us] +/- 55ms 2024-09-17T16:44:51.659 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -632us[ -617us] +/- 90ms 2024-09-17T16:44:51.659 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:44:51.660 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:44:51.660 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-09-17T16:44:51.660 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +163us[ +177us] +/- 50ms 2024-09-17T16:44:51.660 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +240us[ +240us] +/- 55ms 2024-09-17T16:44:51.660 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 -633us[ -619us] +/- 90ms 2024-09-17T16:44:51.660 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:44:51.663 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T16:44:51.663 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-09-17T16:44:51.663 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +155us[ +163us] +/- 50ms 2024-09-17T16:44:51.663 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 +238us[ +238us] +/- 55ms 2024-09-17T16:44:51.663 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -633us[ -626us] +/- 90ms 2024-09-17T16:44:51.663 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T16:44:51.664 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T16:44:51.672 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T16:44:51.673 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T16:44:51.681 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T16:44:51.778 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T16:44:51.849 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T16:44:51.919 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T16:44:51.989 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:44:52.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:52.022 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:44:52.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:52.054 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:44:52.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:52.085 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T16:44:52.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:52.115 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T16:44:52.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T16:44:52.133 INFO:teuthology.task.internal:Duration was 670.512740 seconds 2024-09-17T16:44:52.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T16:44:52.141 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T16:44:52.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T16:44:52.144 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T16:44:52.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T16:44:52.149 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T16:44:52.187 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:44:52.188 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:44:52.188 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:44:52.197 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T16:44:52.678 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T16:44:52.678 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-17T16:44:52.678 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T16:44:52.704 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-17T16:44:52.704 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T16:44:52.734 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-09-17T16:44:52.734 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T16:44:52.758 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-09-17T16:44:52.758 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T16:44:52.791 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T16:44:52.791 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T16:44:52.794 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T16:44:52.796 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T16:44:52.800 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T16:44:52.859 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T16:44:52.860 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T16:44:52.866 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T16:44:52.868 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T16:44:52.871 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T16:44:53.007 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T16:44:53.020 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T16:44:53.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T16:44:53.046 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T16:44:53.072 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T16:44:53.096 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T16:44:53.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T16:44:53.132 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.135 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.138 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.140 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.157 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-17T16:44:53.158 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-17T16:44:53.161 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-09-17T16:44:53.185 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-09-17T16:44:53.217 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:53.233 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:53.248 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:53.262 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T16:44:53.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T16:44:53.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T16:44:53.287 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T16:44:53.287 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi060 2024-09-17T16:44:53.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T16:44:53.324 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi098 2024-09-17T16:44:53.324 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T16:44:53.357 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi111 2024-09-17T16:44:53.358 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T16:44:53.392 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-17_15:01:33-rados-wip-bharath10-testing-2024-09-17-1348-distro-default-smithi/7909084/remote/smithi183 2024-09-17T16:44:53.392 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T16:44:53.425 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T16:44:53.426 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T16:44:53.428 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T16:44:53.430 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T16:44:53.433 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T16:44:53.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T16:44:53.569 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T16:44:53.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T16:44:53.592 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T16:44:53.592 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T16:44:53.595 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T16:44:53.597 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T16:44:53.600 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T16:44:53.608 INFO:teuthology.orchestra.run.smithi060.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 16:44 /home/ubuntu/cephtest 2024-09-17T16:44:53.610 INFO:teuthology.orchestra.run.smithi098.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 16:44 /home/ubuntu/cephtest 2024-09-17T16:44:53.612 INFO:teuthology.orchestra.run.smithi111.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 16:44 /home/ubuntu/cephtest 2024-09-17T16:44:53.614 INFO:teuthology.orchestra.run.smithi183.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 16:44 /home/ubuntu/cephtest 2024-09-17T16:44:53.616 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T16:44:53.626 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T16:44:53.650 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/{bluestore-options/write$/{write_v1} bluestore/bluestore-comp-zlib} rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} duration: 670.5127398967743 flavor: default owner: scheduled_skanta@teuthology success: true 2024-09-17T16:44:53.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T16:44:53.738 INFO:teuthology.run:pass